DOCUHEDT BESUHE 

FI 007 840 

Bilingual Education: An Onioet Need; Beport to the 
Congress by the Comptroller General of the United 
States. 

Comptroller General of the U.S., Washington, D.C. 

19 Hay 76 

78p. 

U.S. General Accounting Office, Distribution Section, 
P. 0. Box 1020, Washington, D.C. 20013 ($1.00) 

MF-$0.t^3 HC-$4.67 Plus Postage. 
^Bilingual Education; Educational Improveient ; 
Instructional Materials; *Language Instruction; 
Language of Instruction; *Language Proficiency; 
Language Skills ; language Teachers ; ♦Program 
Evaluation; *Eeports; Second Language Learning 
♦Elementary Secondary Education Act Title VII; ESEA 
Title VII 



This report from the Comptroller General to Congress 
is designed to assess the effectiveness of the Bilingual Education 
Program and to suggest ways to improve its administration. The 
program as originally conceived is described, and funding, 
participation, and recent legislative developments affecting 
bilingual education are discussed. It is stated that the program has 
progressed little towards its goals of (1) identifying bilingual 
education approaches, (2) adequately training bilingual education 
teachers, and (3) deve?^oping suitable instructional materials. The 
impact of the 1974 Education Amendments on this progress is 
discussed. The effect oi: the program on participating students, 
including an examination of the appropriateness of standardized tests 
is then outlined. Two main factors contributing to the poor 
performance of the target population are isolated: (1) the language 
of limited English-speaking children may not have been used enough in 
classroom instruction, and (2) there may be too many English-speaking 
children in project classrooms, diluting project effectiveness for 
target children. Inadequate monitoring and difficulty in assessing 
English language proficiency also constitute problems. Each section 
of the report is followed by GAO recommendations and by HEW comments. 
The appendices include a review of the characteristics of 1973-74 
bilingual education projects and of parent and HEH stands on 
bilingual education. (CLK) 
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REPORT TO THE CONGRESS 



BY THE COMPTROLLER GENERAL 
OE THE UNITED STATES 



Bilingual Education: 
An Unmet Need 

Office of Education 

Because adequate plans were not made to 
carry out, evaluate, and monitor the Bilingual 
Education Program, the Office of Education 
has progressed little toward 

-identifying, effective ways to provide 
bilingual education instruction, 

--adequately training bilingual education 
teachers, and 

-developing suitable teaching materials. 

No comprehensive information is available on 
the program's effect on students' academic 
progress, but the Office of Education has con- 
tracted for a national evaluation on this. 
Local project evaluation reports have been 
inadequate and of little use to local and 
Federal decisionmakers. 
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To the President of the Senate and the 
Speaker of the House of Representatives 

In this report we assess the effectiveness of the 
Bilingual Education Program and suggest ways to improve 
its administration. The program is administered by the 
Office of Education, Department of Health, Education, and 
Welfare . 

Because the program represents the largest and most 
direct Federal assistance for meeting the special educational 
needs of limited English-speaking children, we reviewed the 
progress of the program in achieving its goals of (1) iden- 
tifying effective bilingual education approaches ,( 2 ) 
adequately training bilingual education teachers, and (3) 
developing suitable instructional materials. We also deter- 
mined the program's effect on participating students at 16 
projects . 

We made our review pursuant to the Budget and Accounting 
Act, 1921 (31 U.S.C. 53), and the Accounting and Auditing 
Act of 1950 (31 U.S.C. 67) . 

We are sending copies of this report to the Director^ 
Office of Management and Budget, and to the Secretary 
of Health, Education, and Welfare. 




Comptroller General 
of the United States 
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COMPTROLLER GENERAL'S 
REPORT TO THE CONGRESS 



BILINGUAL EDUCATION: AN 
UNMET NEED 

Department of Health, Educatiorir 



and ..Welfare 



D G E S T 

As many as 2.5 million children in the United 
States primarily speak, read, and wfite a 
language other than English. They are educa- 
tionally d i sad van t aged because they cannot 
understand instruction traditionally given in 
English. Bilingual education is designed tc 
teach these children English and to teach 
them in their language so they can progress 
effectively through school. 

Bilingual education was relatively new when 
the Bilingual Education Program was estab- 
lished in iy68. The program, administered 
by the Office of Education, Department of 
Health, Education, and Welfare (HEW), was 
intended to be a research and demonstration 
program. 

Because adequate plans were not made to carry 
out, evaluate, and monitor the program, the 
Office of Education has progressed little 
toward 

— identifying effective ways of providing 
bilingual education instruction (see p. 3), 

— training bilingual education teachers (see 
p . 14 ) , and 

— developing suitable teaching materials. 
(See p. 18. ) 

To help prevent this problem from recurring, 
GAG suggests that the Congress establish 
legislative controls over fucui e educational 
demonstration programs. The controls should 
require that Federal agencies be accountable 
for (1) establishing program goals, objec- 
tives, and milestones and (2) assessing the 
program and reporting periodically to the 
Congress on its progress. (See p. 29.) 



Tear Shee t. Upon removal, the report 
cover date should be noted hereon. 
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Ttie Education Amendments of 1974 established 
•priorities and authorized funding for the 
Bilingual Education Program which should help 
the program reach its goals. The Office of 
Education is acting to alleviate the shortage 
of teachers and materials. (See p. 23.) 

No comprehensive information is available on 
the program's effect on students* academic 
progress, but the Office of Education has 
contracted for a national evaluation on this. 
(See ch. 3. ) 

Local project evaluation reports have been 
inadequate and of little use to local and 
Federal decisionmakers. (See p. 30.) 
Further, it is questionable whether available 
testing instruments are appropriate for the 
target population. (See p. 33.) 

On the oasis of available test data, some 
students at 16 projects GAO sampled were mak- 
ing normal progress in math and reading but 
most were not achieving at national norms. 
The test data indicated that English-speaking 
students, who are also allowed to participate 
in the program, generally did better than 
children with limited English-speakinq 
ability. ^ 

Because the 16 pro jects represent only a 
small fraction of all projects in the pro- 
gram, the results of GAO ' s analyses are not 
necessarily representative of the entire 
program. (See p. 34 . ) 

Two factors may have contributed to the poorer 
performance of the target population. 

—The language of the limited English-speaking 
children may not have been used enough in 
classroom instruction. (See p. 45.) 

"Too many English-speaking children were in 
the project classrooms, thus diluting pro- 
gram services for the target children.^ (See 
p. 47.) 

Inadequate monitoring by the Office of Educa- 
tion and the. difficulty of accurately assessing 

I 
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the English language proficiency of the target 
population also affected project effective- 
ness. (See p. 49 . ) 

Project personnel believed nonacademic bene- 
fits to the students included enhanced self- 
image and improved attitudes toward school. 
Reactions of parents of participants were 
generally favorable. (See p. 40.) 

GAO recommends that HEW: 

— Formulate a plan for developing effective 
ways of providing bilingual education in- 
struction. (See p. 28.) 

— Take steps to improve project evaluation' 
reports. (See p. 42. ) 

— ^Examine the appropriateness of academic 
testing instruments available for children 
with limited English-speaking ability and, 
if needed , take action to have better ones 
developed. (See p. 43.) 

— Limit the number of English-speaking 
children allowed in the program, or use 
other methods to further insure that avails- 
able program resources reach the largest 
possible portion of the target population. 
(See p. 52.) 

— Examine the appropriateness of available 
testing instruments for assessing English 
language proficiency and, if needed, take 
action to" have better instruments developed. 
(See p. 52. ) 

In response to GAO ' s recommendations, HEW 
said : 

— The Office of Education and the National 
Institute of Education are formulating a 
plan for systematically developing effec- 
tive ways of providing bilingual education 
instruction. (See p. 28.) 

— It is revising program regulations to -es- 
tablish requirements which should help im- 
prove project evaluation reports. (See 
p. 43.) (GAO believes, however, that 
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stronger and expanded reporting requirements 
are necessary.) (See p. 44.) 



-These agencies are undertaking and planning 
several actions to examine the appropriate- 
ness of test instruments. (See pp. 43 
and 52. ) ' 

-It will review the issue of limiting the 
number of English-speaking children allowed 
in the program. (See p. 52.) 
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CHAPTER 1 



INTRODUCTION 

The Bilingual Education Program was established to meet 
the special educational needs of limited English-speaking 
children from low-income families. The program, authorized 
by title VII of the Elementary and Secondary Education Act 
of 1965, as amended (20 U.S.C. 880b), provides, among other 
things, funds to local educational agencies ( LEAs ) to de- 
sign, develop, and implement approaches for bilingual educa- 
tion. The Office of Education (OE), Department of Health, 
Education, and Welfare (HEW), administers the program, which 
is the largest and which provides the most direct Federal 
assistance for teaching children in another language. 

OE defines bilingual education as the use of English 
and another language as instructional mediums in an educational 
program. Instruction is provided in both languages in some 
or all subjects and the culture associated with the other 
language is also emphasized. Participants can also include 
children proficient in English as well as limited English- 
speaking children. Bilingual education is broader than the 
long-established Engl ish-as-a-second language concept which 
stresses English language instuction for a portion of the 
school day. 

The concept of bilingual education was relatively 
untested in the United States when title VII was approved 
-on January 2, 1968. The Congress, intending it to be a 
research and demonstration program, authorized grants to 

— test the effectiveness of bilingual educational 
approaches through research or pilot projects, 

— provide training for teachers in bilingual education 
programs, 

— develop and disseminate .instruct ional materials, 
and 

— establish and operate bilingual educational programs. 

We evaluated the progress of the Bilingual Education 
Program in (1) identifying effective bilingual educational 
approaches, (2) training teacher s , and (3) developi.ig in- 
structional materials. We also reviewed OE's program im- 
plementation at 20 projects operating during school year 
1973-74. 

XJ 
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Sixteen projects were established at LEAs in nine States 
to address tne special educational needs of limited English- 
speaking school children in those areas. At these projects 
we evaluated— by analyzing available test data— the academic 
progress of a sample of student participants. The projects 
were selected in consultation with OE program officials who 
agreed that those selected could be considered typical of 
the program. Because the 16 projects represent only a small 
fraction of all projects in the program, the results of our 
analyses of achievement data should not be considered neces- 
sarily representative of the entire program. 

The other four projects, national in scope, were estab- 
lished to develop, acquire, and disseminate instructional 
materials and to evaluate test instruments for widespread 
LEA use. (The scope of our review is detailed in chapter 5.) 

DESIGN 
AND ADMINISTRATION 

LEAS wishing to participate in the program submit appli- 
cations to OE. To qualify for financial assistance, an ap- 
plicant must demonstrate that it has school enrollments of 
limited English-speaking children who come from low-income 
families and environments where the dominant language is 
not English. The applicant must also show that the regular 
school program is not meeting the special educational needs 
of this group. 

OE reviews and approves project applications, paying 
particular attention to factors such as problem significance 
and .needs assessment, target group characteristics, project 
objectives and procedures, planned class activities, staff 
development, parental involvement, and proposed budget. 
In awarding grants, OE is required to consider recommendations 
from State educational agencies, the geographic distribution 
of limited English-speaking children, the relative need for 
bilingual education in individual States, and the ability 
of LEAs to provide bilingual education services. 

OE headquarters (1) develops policies for program 
operation, funding, evaluation, and dissemination of results 
and (2) monitors LEA projects. OE ' s Office of Planning, 
Budgeting, and Evaluation has primary responsibility for 
overall program evaluation. Because program administra- 
tion is centralized at OE headquarters, HEW's regional 
offices and the State educational agencies have not been 
involved in the program's administration. 



OE issued program regulations in 1969 and supplemented 
them with program guidelines in April 1971 which contained 



program philosophy; guidance for project design^ implementa- 
tion, and evaluation; and instructions for submitting grant 
applications. In June 1974 revised regulations and proce- 
dures were issued which superseded the guidelines. Title 
VII was amended in August 1974 by the Education Amendments 
of 1974 (20 U.S.C, 821) which, among other things, created 
the Office of Bilingual Education within OE, Revised pro- 
gram regulations became effective on June 24, 1975. 

FUNDING AND PART ICIPATION 

Because title VII was established as a demonstration 
program, OE originally intended that LEAs would absorb proj- 
ect costs after 5 years. However, beginning in school year 
1974-75 projects could be funded for longer than 5 years 
where exceptional potential for achieving program goals 
was demonstrated, but could not be funded indefinitely. 

Federal funds totaling $374.9 million were appropriated 
for the program from its inception through fiscal year 1976, 



Fiscal 


Number of 


Program 




Amount 


year 


projects 


par ticipants 




appropr iated 


1969 


79 


26,500 




$ 7,500,000 


1970 


131 


51,900 




21,250,000 


1971 


16 5 


83,700 




25,000,000 


1972 


210 


106,000 




35,000,000 


1973 


209 


129,500 




45,000,000 


1974 


3bO 


236,000 




58,350,000 


1975 


■ a/381 


268,500 




85,000,000 


1976 








97,770,000 


Total 








$374,870,000 


a/Excludes 


grants to 30 


universities for 


fellowships for 


study in 


the field of 


bilingual education 


training . 


The program is forward funded; that 


is. 


funds appro- 



priated and obligated in one year finance program opera- 
tions the following year. Thus, the 209 projects shown 
above for fiscal year 1973 were implemented in school year 
1973^74. The map on the following page shows (1) the 
concentration of title VII funds in school year 1973-74 
and (2) that *10 States received 83.5 percent of available 
funds. 

Twenty-four languages were represented by the 209 
projects : 

1 ^ 
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—European languages^ — 

French, Portuguese, Spanish 3 

— Pacific Island languages — 

Chamor ro , Palauan , Ppuapean 3 

i 

— Other languages — 

Chinese, Eskimo, Russian _3 

Total 

About 85 percent, or 179, of the 209 projects were directed 
toward Spanish-speaking children. Although prekindergarten 
through grade 12 are eligible for funding, the main emphasis 
has been on kindergarten through grade 6. 

The 20 projects we reviewed received grants totaling 
$4.6 million for school year 1973-74. At the 16 projects 
providing classroom services, grants amounted to $2.2 mil- 
lion and over 10,000 students participated. The languages 
covered by these projects included Spanish (11 projects), 
American Indian (2 projects), Chinese, Portuguese, and 
French. Grants awarded to the four national projects 
totaled $2.4 million. 

In school year 1974-75, the number of projects increased 
to 383, including about 200 new projects. These projects 
serve an estimated 236,000 students — out of a total target 
population ranging possibly from 1.8 to 2.5 million children- 
and encompass 42 languages, including 23 American Indian 
languages. 

rec ent developments affecting 
bTlingual education 

Since title VII was enacted, bilingual education pro- 
grams and related activites have grown substantially at 
all government levels. For example, several States have 
legislation establishing programs to meet the special 
educational needs of limited English-speaking children. 
Of the nine States we reviewed, six — Arizona, California, 
Massachusetts, New Mexico, New York, and Texas— have such 
laws. Indications are that this trend will continue and 
will have a major impact on the direction of existing 
programs . 

On January 21, 1974, the Supreme Court ruled that, 
in Lau v. Nichols , 414 U.S. 563 (1974), public school 
systems must rectify the educational problems of limited 



ha?f'of"cMn^o2^ H^'i'^'^"• decision was reached on be- 

5he CoL? i^^IJ children against an LEA in San Francisco. 
The Court based its ruling on title VI of the Civil Riqhts 
Act of 1964 (42 U.S.C. 2000d) and held that a school system 
receiving Federal funds unlawfully discriminates against 
limited English-speaking children if it fails to ?ope with 
^^rLi^"^""^^^ problems. Under such circumstances, children 
Honf? ^'^"f opportunity to participate in the educl- 

wn? ir.K a result of this decision, more LEAs 

will probably begin bilingual education programs. 

The Education Amendments of 1974 extend the bilingual 

!n^rLo°" i'^'^^"^'^ fi^^^l y^^' 1978 and consideLbly 

increase authorized program funding. The amendments also 

f^onf^^^h ^^""^ ^ significant impact on program opera- 

tions. This is discussed in chapter 2. 
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CHAPTER 2 
RESOURCES TO EXPAND BILINGUAL 



EDUCATION_HAV£^t^ 

Through projects funded under the Bilingual Education 
Program, local educational agencies have attempted to meet the 
educational needs of school-age children with limited English- 
speaking ability. however, OE did not establish an adequate 
management plan to implement, evaluate, and monitor the pro- 
gram. Consequently, OE Vs overall goal of developing resources 
to effectively expand bilingual education has not been met, 

— Only four effective bilingual educational approaches 
have been identified. 

— Some bilingual education teachers have been trained, 
but a critical shortage of adequately trained teachers 
still exists and not enough training facilities are 
available to provide appropriate training. 

— Some progress has been made in developing Spanish- 
language instructional materials; however, more ma- 
terials are needed, particularly in other languages. 

It will be extremely difficult to effectively expand 
bilingual education until these resources are sufficiently 
developed. These resources are critical because, as previ- 
ously discussed, LEAs will probably be starting new bilingual 
programs as a result of recent court decisions. The Educa- 
tion Amendments of 1974 mandate noveral activities which 
should help alleviate the shortage of resources and OE has 
taken certain actions, accordingly. 

PROGRAM GOALS AN D OE 
DATA ON GOAL ATTAINMENT 

The Congress and O.E recognized that, because bilingual 
education was relatively new, certain resources had to be 
developed before extensive proqrams could be established to 
reach all children of limited English-speaking ability. 
Accordingly, the program goal has been to develop these 
resources — effective bilingual education approaches, ade- 
quately trained bilingual education teachers, and suitable 
teaching materials. The effect on program participants is 
discussed in chapter 3. 

OE has relied primarily on annual internal" evaluations 
and LEA project evaluation reports to determine whether the 
goals have been achieved.. However, neither method has yielded 
comprehensive, useful data on program effectiveness. 
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OE s Office of Planning, Budgeting, and Evaluation 
prepares a status report for the Congress on the progress of 
all OE-funded education programs. In its fiscal year 1974 
report, OE stated that: 

"In general * * * it would appear that title VII 
has succeeded as a demonstration in that, however 
informally, interest has been generated and models 
are being replicated." 

The portion of the report concerning bilingual education was 
based on a program evaluation made for OE by a private firm 
It showed that many title VII projects are visited by person- 
nel from other LEAS. Of 34 projects included in the study, 
31 had been visited and 10 had been at least partially repli- 
cated (duplicated) by 1 or more LEAs. 

OE's annual report lacked information on the orogress 
made in training bilingual education teachers and in develop- 
ing instructional materials. The contractor's final reportT 
dated December 1973, acknowledged the existence of severe 
shortages in both areas but did not provide perspective re- 
garding national needs or ongoing efforts to find appropriate 
solutions. ^ 

LITTLE PROGRESS MADE I N 
IDENTIFYING EFFECTIVE BILINGUAL 
EDUCATI ONAL APPROACHjS 

Although the program is in its seventh year of furnish- 
ing classroom services to limited English-speaking children, 
OE has made little progre-,s in identifying effective bilingual 
educational approaches. As of December 1975, only four ap- 
proaches had been identified. 

Characteristics o f bi lingual- 
ed ucational approach e s 



According to OE, bilingual educational approaches have • 
several common elements: instructional design, evaluation, 
staff training, materials acquisition and development, and 
community participation. Each element contains variables 
which can be structured to form a different approach. 

To illustrate, in terms of instructional design LEAs 
are concerned with variables such as classroom mix of limited 
English-speaking and English-speaking students, percentage 
of time each language will be used, and emphasis each subject 
will be given, including the sequential pattern of teaching 
subjects at various grade levels. Another consideration is 
which instructional technique ^to employ— team-teaching , 

1 V 
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small group instruction, individual tutoring, or some other 
technique or combination of techniques. Instructional de- 
sign also encompasses personnel resources which can imple- 
ment the classroom approach. Examples include: 

— A bilingual aide assisting a monolingual English- 
speaking teacher . 

— A bilingual teacher and bilingual teacher aide 
instructing small groups of students alternately 
in the two languages. 

--A bilingual teacher exchanging students with a 
monolingual English-speaking teacher to provide 
instruction in two languages. 

Procedures are also necessary for evaluating the imple- 
mentation of the instructional design. An evaluation design 
should consider processes and products to be measured, meas- 
urement instruments or techniques to be applied, data collec- 
tion and analysis procedures to be used, and reporting format. 
Selecting appropriate measurement instruments or techniques 
is important. Some alternatives, for example, are standard- 
ized achievement tests, teacher-developed tests and rating 
scales, classroom observations, and questionnaires. 

QE 's efforts to ide n ti fy approache s 

In the program*s first year, OE received over 300 LEA 
applications for bilingual education projects. Seventy-nine 
were awarded grants and became operational in school year 
1969-70. Differences in school resources and organization, 
as well as in community composition, resulted in the use of 
various approaches to implement the projects. 

Although many and varied approaches were carried out, 
OE had little control over which approaches would be evalu- 
ated and compared, how it should be done, and for how long. 
As previously discussed, the Congress intended the program 
to test the effectiveness of bilingual education approaches 
through research or pilot projects. Because OE had little 
control, the program lacked the characteristics of a demon- 
stration program. In its fiscal year 1971 status report to 
the Congress, dated January 1972, OE stated that: 

"During its three years of operation, the Bilingual 
Education Program has become more and more of an 
educational service program, rather than a demon- 
stration one." 
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OE created a task force in 1971 to determine whether 
bilingual education should be expanded from a demonstration ■ 
to an educational service program. In October 1971 the tasic 
force reported that evidence on the effectiveness of bilingual 
education projects was inconclusive. Among other things, it 
recommended that OE play a stronger program role by further 
directing developmental activities and initiating a "planned 
variation" component. Such a component would identify effec- 
tive Dilingual education strategies by systematically evalu- 
ating different approaches. The task force explained its 
position by stating: 

"It is recommended that 'planned variations' of 
bilingual models should be tried out systemati- 
cally. Some of the most promising models worked 
out by the various projects should be tried out 
m a more systematic way. The development of 
such models is a difficult task and should begin 
at once. It may be well to stage .these trial 
ru^is m areas which presently have no bilingual 
program so that the Office of Education may spe- 
cify which model shall be tried out. All the 
schools chosen to participate in the new planned 
variation part of the program would be subject 
to an intensive, common evaluation for the pur- 
pose of determining which models are the most 
effective." 

u „^,^^^se recommendations were not implemented. According 
to HEvV officials, a "planned variation" study design was 
developed under a 1972 research grant costing about $300,000 
However, the design was not implemented because of several 
concerns, including cost and OE's ability to control the 
experiment at each LEA. 

OE did not establish objectives and milestones to iden- 
tify educational approaches for LEA use until 5 years after 
the Congress first appropriated program funds. In fiscal 
year 1971, hew established the Operational Planning System 
to help manag,ement with resource allocations. Among other 
things, the system is intended to insure that long-range 
goals are accomplished. It requires HEW activities to develop 
clear, measurable objectives indicating what each program 
plans to accomplish in terms of output or impact and to set 
milestones to measure effectiveness in achieving objectives. 

In fiscal year 1974, 3 years after the HEW system was 
established, OE developed an objective and milestones de- 
signed to insure that effective bilingual educational ap- 
proaches were validated and disseminated. OE's fiscal year 
1974 objective stated that 10 effective title VII approaches 
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would be available for dissemination to LEAs by June 30, 
1974. Significant milestones were: 

— By March 1974, prepare criteria for identifying 
effective bilingual and bicultural educational ap- 
proaches and list title VII projects deemed worthy 
of further examination. 

—By April 1974 , make visits to identified projects 
to validate evaluative and programmatic data. 

By May 1974, submit information on effective title VII 

projects to OE's Dissemination Review Panel 1/ for 
approval. 

Fifteen projects were identified as having potential for 
LEAS to replicate. Each project was visited for no more than 
2 days by OE vali-d-ation teams to collect project data and 
verify its accuracy and reliability. An OE official told us 
that the 15 projects were selected subjectively by program 
personnel from 38 fifth-year projects recommended for school 
year 1974-75 funding. Of the 15 projects, only 4 were sub- 
mitted to the Dissemination Review Panel for approval. But, 
in September 1974, the panel disapproved the projects because 
each lacked objective data on the participants' academic 
achievement. 

In June 1974 OE awarded a contract estimated at $1.1 mil- 
lion for an overall evaluation of the Bilingual Education 
Program, One objective was to identify up to 10 exemplary 
projects. OE's Office of Planning, Budgeting, and Evaluation 
and the contractor cooperatively defined minimum criteria for 
screening candidate projects. To be considered, projects 
had to 

include English-language instruction for children with 

limited English skills, 

— provide academic instruction in the language of the 
target population, 

— address the customs and cultural history of the tar- 
get population. 



1/In April 1974 the Assistant Secretary for Education changed 
~ the panel to a joint National Institute of Education and OE 
Dissemination Review Panel. It is responsible for reviewing 
and approving all educational products and materials pro- 
posed for public dissemination. 
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wpT? 5^^"^ English-language skills as 

well as content areas taught in the native language, 

--have definable and describable instructional and man- 
agement components, and 

— have reasonable startup and continuation costs. 

A total of 175 candidate projects were selected most 
of which were funded under title VII. As a rJsuU of a tJle- 
Phone screening, 59 1/ projects were dropped without reqSeit- 

"Ite'Ha"' An^add??'^'' ^^5^^^ ^'^^ '"-^ 

hJn.nL ;h additional 20 projects .could not be considered 

because the requested evaluation reports were not received 

• n.i "^""^ evaluation reports of the remaining 96 projects were 
analyzed for information on their success of failure The 
evaluation methodology of 89 of the projects was fou^d to be 
laiiCrelou^d ''f.' conclusion on the project's success°or 
^:g;s^^9^°?:^t"thatr• -ntractor^s .eport, dated 

"Some of the more common shortcomings encountered 
in reviewing evaluation designs were the follow- 
ing: insufficient or inappropriate comparative 
data, small numbers of participants and/or control 
students, unanalyzed data, data reported for one 
aid f.nnK^ only, inappropriate testing procedures, 
and failure to collect, in addition to data from 
language tests, data from tests in other subject 

instances, program documents sup- 
plied little or no information on cognitive 
achievement of participants." 

n,-^. "^"^^ remaining seven projects were recommended to the 

lllTeTtT vV""'l exemplary Dilingual education 

projects. The panel approved four of the projects for dis- 



1/In a few instances calls were made as a result of false 
leads and no special program for limited Engl ish-soeakina 
students was operating. Also, some programs were dropped 
at their own request. ^ppcu 
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Progr am title 

St. John Valley Bilingual 
Education Program 



Location 



Lan guage 



Madawaska, Maine 



French 



Alice Independent School 
District Bilingual Education 
Program 



Alice f Texas 



Spanish 



Aprendemos en Dos Idiomas, 
Title VII Bilingual Project 



Corpus Chr i st i , 
Texas 



Spanish 



Bilingual Education Program 



Houston, Texas 



Spanish 



Program descriptions detailing the content and key char- 
acteristics of the four projects were prepared by the con- 
tractor. OE officials told us that the descriptions will be 
made available through the title VII program to LEAs seeking 
ideas on program design in fiscal year 1976. In addition, 
OE has awarded a contract to prepare "Project Information 
Packages" on the projects. The packages will go beyond the 
program descriptions by detailing the project processes and 
by showing LEAs how to implement the design in its entirety. 

OE officials told us the project information packages 
are scheduled to be completed by the summer of 1976. They 
said that tentative plans call for a 2-year field test of 
the packages and, if the field tests are successful, the 
packages will be disseminated on a widespread basis to LEAs. 

e fforts to identify and valid ate 
successful approaches needs re"dlre ct ion 

Although OE has identified four approaches which have 
shown effective results and have the potential for replica- 
tion, it needs to formulate a systematic plan to develop such 
approaches. As stated earlier, for the title VII candidate 
projects included in the contractor's study, OE had little 
input into the design and development of particular projects. 

Title VII grants are awarded on the basis of the extent 
to which basic funding criteria are met. The particular ap- 
proach or strategy to be implemented is primarily left up to 
the discretion of the grantee. OE does not have a plan for 
testing particular approaches which are likely to work or 
particular variables which are believed to have impact on 
project effectiveness. 

Also of particular concern are the inadequacies^ of the 
evaluation designs developed and implemented at local proj- 
ects. In commenting on the few models that have been iden- 
tified, the August 1975 report stated that; 
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'Practically every study of this type over the 
years from several research organizations and 
across a variety of educational programs, includ- 
ing compensatory education, readirfg programs and 
now bilingual education, has pointed to poor ex- 
perimental design, to the lack of planning for 
evaluation, to inappropriate use of statistical 
methods, and to a general lack of evidence one 
way or the other." 

Consequently, although title VII projects have implemented a 
wide variety of approaches for providing bilingual instruc- 
tion, their evaluation designs have been so inadequate as to 
precluae the project's data from even being considered by 
OE s Dissemination Review Panel. It would seem, therefore, 
tnat strong evaluation designs should be an intrinsic part 
of demonstration projects to provide greater assurance that 
reliable data on project effectiveness will be available 
Chapter 3 discusses in more detail LEA evaluations. 

i?i§iiL£ICIENT_3UPPLY_0F 
§Itiii5Mt_^Hy£^TI ON _T E AC H ERS 

Objective evidence is lacking on whether students oer- 
torm better because they have been taught by a bilingual 
education teacher. Nevertheless, educators and OE officials 
agree that additional qualified teachers are needed. 

In March 1974 we reported to the Congress that a na- 
tional surplus of elementary and secondary school teachers 
existed, but there were shortages in some subjects and in 
certain localities. 1/ Little progress has been made in 
tilling the bilingual education teacher shortage and OE has 
not quantified this need. Progress in training teachers has 
been hampered because (1) the capability of colleges and 
universities to provide the necessary training has been 
limited and (2) previous Federal teacher training programs 
have not been successful in meeting the teacher shortage 
need. The following three sections include a discussion of 
Ob s progress in these areas before enactment of the Educa- 
tion Amenaments of 1974. 

Teacher shortage has 
not been quantified 

Although estimates have been made, OE has not adequately 
determined now many additional bilingual education teachers 

l/"Supply and Demand Conditions for Teachers and Implications 
for Federal Programs," B-164031(l), March 6, 1974. 
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are needed to serve the target population. A major factor 
effecting estimates of teacher need is the size of the target 
student population; however, OE has not made a comprehensive 
study of this population. OE also lacks comprehensive infor- 
mation on State and LEA qualification standards for bilingual 
education teachers and on how many teachers meet such quali- 
fications. 

In recent years, estimates of the target population have 
r'anged from 1.8 to 7 million nationwide, and the correspond- 
ing estimated teacher need has varied accordingly. One rea- 
son for the wide variance is that the language characteris- 
tics of children needing bilingual education have not been 
well defined. (See ch. 4.) 

In March 1974 OE estimated that about 1.8 to 2.5 million 
children needed bilingual education and, using a classroom 
student-rteacher ratio of 30 to 1, estimated that the number 
of teachers needed would range from 60,000 to 83,000. How- 
ever, the estimate is inadequate because it was based on a 
sample of only four States, on. 1970 census data on homes 
where foreign languagf^.^ were spoken, and on a 1972 survey 
of national ethnic origin of minorities made by HEW's Office 
for Civil Rights. Educators generally recognize that such 
data does not accurately measure a child's ability to func- 
tion in English. 

Although nationwide estimates have varied significantly 
and generally have been inadequate, there is evidence that 
additional bilingual education teachers are needed. For ex- 
ample, at the projects we reviewed, 292 teachers provided in- 
struction to project participants. Of these teachers 200, or 
69 percent, were bilingual — fluent in and able to understand 
English and the target students' native language. However, 
at five pi ejects the majority of the teachers were not bilin- 
gual. Also, only 74, or 27 percent, of the 271 teachers for 
whom information was available had received college training 
to teach in bilingual classrooms. Most LEA project directors 
told us the shortage of qualified teachers adversely affected 
their projects, including the quality of instruction. 

A 1973 OE-financed study of 34 Spanish projects, which 
were not included in our review, resulted in similar findings. 
The contractor's report concluded that: 

VMl teachers employed in the * * * projects were 
certified. However, not all these teachers were 
qualified to teach in a bilingual education pro- 
gram. Consequently, there is a lack of formally 
trained and bilingually qualified teachers to 
instruct in bilingual education programs. The 
lack is impacting on * * * project success." 

^ / 15 
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Tne LEAS included in the OE study considered 370, or about 
/J percent, of the 510 teachers to be qualified to teach 
in Spanish?'''' ^^^^^^ge arts, history, science, and math 

Initial OE program guidelines specified that proiect 
inMnJ^L^M^ K-l'^''^ certain qualifications and competencies, 
P^niriin^ bilingual capability, (2) training and teaching 

experience, using the language of the target population as a 
medium of instruction, (3) training and experience in teach- 
ing English as a second language, and (4) an awareness of the 
target students' culture. We requested information on teacher 
qualifications for the nine States covered in our review 
Of the seven States that responded, five State educational 

?!rf'^r;^''f°Kf? u4'J°'"'^' Massachusetts, New Mexico, and 
• Texas— had established bilingual education teacher certifica- 
tion standards The standards and the requirements to meet 
them varied, although four States stressed bil ingual ism, cul- 
ture, and instruction methods. Of the 16 LEAs we reviewed, 
ii had established minimum standards, but oroject officials 
were generally unaware of State standards. 

3!££iQill2_EIO££Ms_£f_coU.e£es 

OE has not comprehensively assessed the ability of 
colleges to train students to be bilingual education teachers 
"^L u^f.^^ "^^^^ comprehensive data on the number of students 
with bilingual Capability who are enrolled in colleges and 
maDormg m teacher education. Using questionnaires, we sur- 
veyed colleges m the nine States we reviewed to ascertain 
tneir training capabilities in this field. Although several 
offered courses related to bilingual education, few had com- 
prenensive training programs or offered degrees and creden- 
tials m bilingual education. 

OE officials believe that not enough colleges are capable 
of training bilingual education teachers to meet current 
needs. In October 1974, using information available within 
OE and other HEW agencies, OE identified 101 colleges in 
15 States and the District of Columbia as having an estab- 
lisned program or some training activity in bilingual educa- 
tion. OE s data showed that 47 offered degrees and 51 offered 
courses related to bilingual education; specific information 
on the remaining 3 institutions was not given. Of the 51 in- 
stitutions offering courses, 17 offered only Engl ish-as-a- 
second language training, 'information regarding degree re- 
quirements was not provided. 

The National Council for Accreditation of Teacher Edu- 
cation is the national agency for accrediting programs that 
prepare elementary and secondary education school teachers 
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and school service personnel. We sent questionnaires to the 
112 colleges accredited by the Council in the 9 States we 
reviewed. Of the 91 institutions responding 78, or about 
86 percent, indicated a need for bilingual education teacher 
training programs in their area. However, only 23 institu- 
tions said they offered degrees or credentials related to 
bilingual education; 46 said they had courses related to 
bilingual education. A breakdown of the questionnaire re- 
sponses is shown below. 



St ate 

Ar izona 

California 

Colorado 

Louisiana 

Massachusetts 

Montana 

New iVexico 

New York 

Texas 

Total 



Need for 
training 
programs 



Yes 


No" 


2 


0 


18 


0 


5 


1 


0 


4 


14 


0 


2 


1 


4 


0 


13 


5 


18 


_2 


78 


13 



Offer degrees 
or credentials 



Yes 


No 


1 


1 


3 


10 


1 


5 


1 


5 


1 


13 


0 


3 


3 


1 


5 


13 


_3 


17 


23 


68 



Offered cour^ses 



( note 


a) 


yes 


No 


1 


0 


8 


2 


5 


0 


1 


4 


d 


4 


3 


0 


1 


0 


5 


8 


13 


_4 


46 


22 



Percent 86 14 25 75 68 32 

a/Represents the 68 colleges not offering degrees or creden- 
~ tials in bilingual education. 

The training programs established by the institutions 
offering degrees or credentials are relatively new; many were 
formulated as recently as 1973 and 1974. Statistics provided 
by 19 of these institutions indicated that 882 persons had 
received degrees or credentials in bilingual education, while 
1,U98 were still participating in the programs. Institutions 
not having comprehensive training programs indicated that the 
main factors impeding their development were limited financial 
resources and lack of experienced professors. 



Federal ly finance d _b i 1 i n u al 
edu cation tr aininag^og^ams 

Federal support for training bilingual education teachers 
is provided under several legislative authorities, the most 
significant being title VII of the Elementary and Secondary 
Education Act. The Education Profession? Development Act 
(20 U.S.C. 1091) enacted June 29, 1967, and the Emergency 
School Aid Act (20 U.S.C. 1601) enacted June 23, 1972, also 
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teacher training programs. The accomplishments 
of these programs are difficult to measure because suff i- 

^x^^n^'^f°^H^^;°^'^ readily available on the nature and 

extent of the training. Our March 1974 report on teacher 

supply and demand noted that agencies lacked adequate infor- 

sJpp?5. of Federal programs on ?eacher 

Training provided under title VII has increas-d the 
teaching capability of individuals at LEA projects,' but has 

to fulfill apparent national nLds. The original 
legislation made grants available to colleges applying joinUy 
^Mnc^"^ or more LEAS. The law did not provide for scho?ar-^ 
hn?L°'i i individuals wanting to pursue a 

bilingual .education teaching career or direct grants to 
colleges. Grant funds could be used for providing (1) pre- 
service tra.ning to prepare teachers, teacher aides, or 
other ancillary educational personnel, such as counselors, 
for participation m bilingual education programs and (2) in- 
service training and development programs to enable these per- 
sons to improve .their qualifications while in such programs. 

Preservice training generally involves a basic orienta- 
tion concerning program goals and approaches and is usually 
offered immediately before the school year begins. Inservice 
=n^'?i"? various times throughout the school year 

and includes instruction in the methods of teaching certain 

tr.V.il^ °" """.^^ teaching materials. Both types of 

training vary according to LEA needs. 

in o^?''''?''''^"^ ^? information, the estimated funds spent 
m school years 1^72-73 and 1973-74 by title Mil projects for 
training and the number of teachers and teacher aides ' rece iv- 
mg training nave been as follows: 

School Recei ving training 

Funds s£ent TeiHh^ " rilg her ai d? s 

(millions) 

Wll'll ^I'i 3,692 2,592 

^^^'-^^ 5.3 3,700.. 2,600 

PROGRESS MADE IN D EVELOPING 
§2II^BLE_INSTRUCTI0NA L MATERI ALS 

Shortages of suitable instructional materials have 
hindered program success. OE has attempted to alleviate 
tnis problem by funding three national projects to develop 
acquire, and disseminate instructional material and by sug- 
gesting that each local project have a materials development 
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component. Some progress has been made, particularly 
regarding Spani.sh-language materials. However, more effort 
is needed to insure that LEAs have access to the quality 
material necessary to provide limited English-speaking 
children with meaningful education opportunities. 

More instruc tiona l 
materi als needed 

The lack of sufficient bilingual instructional materials 
is generally acknowledged by OE, as well as local educators. 
For example, i-n"'hear ings before the Senate Appropriations Com- 
mittee in May 1974, an OE official said "* * * we know that 
there needs to be a substantial increase in the kind of in- 
structional materials which can be used in bilingual educa- 
tion." 

At only four projects we reviewed did most of the staff 
believe the material was satisfactory. Overall, more than 
60 percent of the project directors and teachers indicated 
the material was inadequate and that the lack of suitable 
materials had adversely affected classroom instruction and 
project effectiveness. The 1973 OE-sponsored study of 
34 projects resulted in similar findings. The study said: 

"Of 34 projects queried, only one. project reported 
being totally satisfied with existing bilingual 
education materials. In 33 projects, the general 
consensus was that additional bil ingual/bicultur al 
materials are needed in all areas of instructions 
* * *. Staff members in all 34 projects indicated 
that the inadequate * * * materials had been a 
constraining factor in the conduct of their ac- 
tivities. Most projects were attempting to tap 
multiple sources of materials without really im- 
pacting on the materials problem." 

Project teachers and directors we interviewed said the 
biggest need was for a systematic, sequential pattern of 
instruction in the other language; that is, a complete 
language arts curricula. Without access to such a curricula, 
teachers must develop or adapt material themselves. However, 
as the OE-sponsored study revealed, teachers who developed 
their own material did so based on their own needs, instead 
of developing an integrated curricula which could be used by 
other LEAs. 

The most acute material needs were experienced by the 
non-Spanish projects. For example, the two Indian projects 
we reviewed do not have a written language. Consequently, 
one LEA delayed implementing its project because time was 
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consumed developing a dictionary and other materials The 
Chinese project reviewed obtained some material from^Hona 
Kong and another title VII Chinese project. The teachers 
.claimed that an inordinate amount of their time i^ spent 
developing or adapting materials for project pLtLip^nts. 

One reason for this situation is that the national 
projects are oriented toward the Spanish speaking For 
example one national project responsible for disseminatina 

Tln'/ll t'^e fndlin'f Chinese' rio'rJug^'L^e', 

?nf™ ^ Indian languages, although it has disseminated 

information on certain manuscripts which are available ?n 
these languages Officials at four of the f ive non-sja^ish 

P o :cts' ?:r'!nstr''^'''^''^^ "^^^^ ^^PP^^ ^^e national 

piojeccs ror instructional material. 

Ii££5L:E£°lectsJ_ef f orts_to 
lilL-"' gtet-ial sh ortages 

adonh^"an^^i program guidelines suggested that LEAs acquire, 

spent 's240 000 'on^h"''' '"J ^ • projects we reviewed ' 
spent $240,000 on these activities in school year 1973-74 
Most projects gave this component a relativel? low priority 

less%ha^ sle'rcent'? development, with 8 allocating 

mateA'ali^''^L^l^t ^^^^^^^^ methods to provide students with 
materials. Some materials were acquired from the national 
centers, some were adapted from commercial sources aid ' 
others were developed by teachers and aides. Seve^ projects 
employed curriculum specialists to assist in thileffort 
Although most material adapted or developed was supplementary 
rhere were a few notable exceptions. For instance 1 oroW^' 

a^nd^^^^lag^^ T.T, ^^^^^ - -Sd^^^^ 

2£Zll22]B£Bti_acguisitj.oi^^ 
^ilsemj.i2ati.on_of materials 
b y nationa l project s 

OE has funded three national projects specificallv tn 
provide LEAS with the material necessary to impiemenJ bilin- 
limltld^'h programs. Progress by these projects has been 

d^" t' ?Ied^l™^^^"^ ^ The projects are 



2d 

20 



Project and 
location 



Spanish Curricula 
Development Center , 
Miami, Fla. 



Materials Acquisi- 
tion Project, 
San Diego, Calif. 



Fiscal 

year 
started 



1970 



Cumulative 
funding 
(note a) 



Purpose 



(mill ions ) 
$2.6 



1970 



Dissemination Center 1972 
for Bilingual- 
Bicultural Education, 
Austin, Tex.. 



a/Through fiscal year 1974. 



To develop curricula 
to support primary 
level grades (1-3) 
in Spanish-English 
bilingual education 
programs. 



$2.0 To locate and dis- 
seminate Spanish and 
Portuguese instruc- 
tional materials 
published in foreign 
countries for ele- 
mentary and secondary 
grades . 

$0.6 To serve as a clear- 
inghouse for bilin- 
gual/bicultural ma- 
terials and services 
relevant to title VII 
projects. 



Following is a dis.cussion of the progress made by these 
three projects, primarily before enactment of the Education 
Amendments of 1974. 

Sp anish Curricula 
Development Center 

To determine LEA needs, the Center made a survey and 
found that curricula was desired in five subjects: language 
arts, social science, fine arts, math/science, and Spanish- 
as-a-second language. The material for each subject, includ- 
ing texts, teachers' guides, and test instruments, is devel- 
oped by Center personnel "and sent to selected LEAs for field 
testing and comment. The Center then revises the material 
to correspond to the dialects and cultural characteristics 
of the three target populations (Mexican, Puerto Rican, and 
Cuban) and sends it to the Dissemination Center for Bilingual- 
Bicultural Education. 
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As of December 1975, the material for grades one and two 
had been field tested, revised, and sent to the Dissemination 
Center. The material for grade three had been field tested 
and revised, and the material for grade four was being field 
tested. According to Dissemination Center records, 52, or 
36 percent, of 137 title VII Spanish-English projects which 
cover first grade had purchased some material as of August 
1974. 

The Development Center's effectiveness has at times been 
difficult to assess, primarily because of peak and low periods 
relative to recei/ing teacher feedback. In school year 

1973- 74, teachers at 40 Spanish-English projects were test- 
ing the material in their classrooms. According to the 
Center's 1973-74 annual report, teachers expressed a "gen- 
erally positive attitude" toward the material. However, 
Center officials were disappointed that half the teachers 
provided no input and that many evaluations were not of suf- 
ficient quality to improve the materials. For school year 

1974- 75, to improve feedback, a Center official told us that 
the Center contracted with teachers to field test materials. 

During school year 1973-74, the Center attempted to 
assess the effectiveness of the first grade language arts 
material. A test developed by the Center and keyed to the 
material's objectives was aaministered twice during a 5-month 
interval to 216 students at 3 different sites. Two groups 
of students were tested. One group participated in bilingual 
classes using material from various sources and the other 
group used only Center material. Test results showed that 
the group using Center material had gains about 32 percent 
higher than the other group. 

i^at erials Acquisition Proj ec t 

As of June 1975, Project personnel accumulated an inven- 
tory of over 36,000 items of instructional material. The 
Project uses various activities to place material in bilin- 
gual classrooms. For example, teachers from participating 
LEAS select material from the inventory and evaluate it, de- 
termining whether the material is appropriate for title VII 
participants and, if not, indicating necessary revisions. 

During fiscal years 1972-74, 26, 106, and 129 bilingual 
education projects, respectively, received material. In 
school year 1973-74 the projects filled purchase orders 
valued' at more than $300,000. Numerous workshops and meet- 
ings have been conducted to help teachers use and evaluate 
the material, and from 1972-75 over 2,000 teachers partici-. 
pated . 

3x 
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According to the Project's 1973-74 evaluation report, 
it has had difficulty in obtaining enough substantive evalua- 
tions to enable it to improve existing material. Of the 
12 Spanish and Portuguese projects we reviewed, 7 had ob- 
tained material from the Project and were generally satis- 
fied with it. 

Disseminatio n Cent er 

The Dissemination Center evaluates instructional material 
submitted by title VII projects to determine whether it is 
worthy of dissemination to LEAs. As of December 1975, the 
center had on hand manuscripts of over 1,000 unpublished ma- 
terials. The Dissemination. Center director estimates that 
only 10 to 15 percent of the material received is suitable 
for dissemination. Materials are rejected primarily because 
they (1) duplicate existing material, (2) are not universally 
applicable, or (3) are not developed according to generally 
accepted text development procedures. With few exceptions, 
material is not formally field tested before dissemination. 

Dissemination Center records do not readily provide 
summarv data on how many local projects submit material or 
on the^ amount of material submitted. However, our review of 
available records showed that 11 of the 16 projects we re- 
viewed had submitted a total of 117 manuscripts from school • 
ye?rs 1971-72 through 1973-74. 

Projects purchase at cost a wide variety of material, 
most of which is supplemental. According to a Center offi- 
cial, in school year 1974-75 over 191,000 items were dis- 
seminated. Thirteen of the 16 projects we reviewed received 
147 pieces of material covering several subjects and grades. 

As pai-t of the -Dissemination Center's 1973-74 evaluation, 
the evaluator requested projects to rate specific material. 
The response rate was very low, but those who did respond were 
favorably impressed. In school year 1974-75, a questionnaire 
sent by tne Center to a number of projects showed that an 
overall assessment of all material being used was favorable. 

IMPACT OF EDUCATION 
AilfN DME f^S_0 F_ 197 4 

The Education Amendments of 1974 mandated certain activi- 
ties in an attempt to reduce bilingual education resource 
shortages. As a result, the Under Secretary of HEW formulated 
a capacity building policy for bilingual education which em- 
phasizes teacher training and development of instructional 
approaches. We believe that both the revised program legis- 
lation and HEW's capacity building policy should help reduce 
the shortage of bilingual education resources. 

23 



Education Amendments of 1974 

d^-nonoTr.?°"^^r\^^^'^^^^^^ °f program funds to 

ThP ?Io[Ji -^"^""^'^^ "^^^ °^ providing bilingual education. 
The legislation requires that: cl-xwh. 

"The Commissioner * * * shall establish, publish 
and distribute, with respect to programs of bilin- 
gual education, suggested models with respect to 
pupil-teacher ratios, teacher qualifications, and 
other factors affecting the quality of instruction 
offered m such programs." (20 U.S.C. §8806-1 (b)) 

To emphasize its concern, the Congress authorized $5 mil 
lion for each fiscal year through 1978 to be used, in part? 
for developing effective demonstration projects In addi^ on 
the Education Amendments of 1974 providrthat- ^^d^t^on 
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"The National Institute of Education shall * - 
carry out a program of research in the field of 
bilingual education in order to enhance the 
effectiveness of bilingual education programs 
carried out under this title and other programs 

fon r^^';^^"^ °^ limited English-speaking ability. 
(20 U.S.C. §d806-13(a)) ^ 

"In order to test the effectiveness of research 
finamgs by the National Institute of Education 
and to demonstrate new or innovative practices 
techniques., and methods for use in such bilingual 
education program, * * * [the National Institute 
of Education and OE] are authorized to make com- 
petitive contracts with public and private educa- 
tional agencies/ institutions, and organizations 
for such purpose." (20 U.S.C. §8806-13(b)) 

The legislation considerably expands OE's role in train- 

p!?ov?dtr?hai ^ni?^''°" teachers. For example, the law now 
provides that colleges can receive direct grants or contracts 
and that fellowships leading to graduate digrees can be 
awarded to prepare individuals to train teachers for bilin- 
?o °" programs. The legislation also requires OE 

f?rfr^?n^-ff?^"^ 5°' training at least $16 million of the 
onl : iu°" °^ appropriated program funds, and at least 

^fJn i • •^''^■^PP''°P'''^t^°"^ o^^'' ?70 million. In addi- 
tion, beginning m school year 1976-77 LEAs are required to 
expend 15 percent of their grant funds on training? 

The law requires OE to provide two reports to the Con- 
tl'oTin^^H''^ President on the "condition of bilingual edCca- 
^in n S n of^^°" administration and operation" 

(20 U.S.C. §8806-10(c)) of title VII. The reports, due in 
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November of 1975 and 1977, are to include (1) a national _ _ 
assessment of how many teachers are needed to carry out bilin- 
gual education, (2) a description of activities to prepare 
teachers and other education personnel for such programs, and 
(3) a phased plan for training necessary personnel to expand 
such programs to all preschool and elementary school children. 

The Education Amendments of 1974 also underscore the 
importance of appropriate instructional materials. The law 
directs OE and the National Institute of Education to "* * * 
develop and disseminate instructional materials and equip- 
ment suitable for use in bilingual education programs." 

OE actio n 

To assist LEAS needing bilingual education programs and 
to respond to the Education Amendments of 1974, OE plans to 
shift program emphasis from classroom services to a capacity 
building strategy. The strategy was outlined in a memorandum 
dated December 2, 1974, from the Under Secretary of HEW to 
the Assistant Secretary for Education (see app. II) which 
stated that: 

"* * * the Administration and Congress have assumed 
a Federal capacity building role in the area of 
bilingual education. This role includes such re- 
lated activities as research, testing, and dis- 
semination of educational approaches, models and 
techniques for teaching students with special edu- 
cation needs, curriculum development, teacher 
training, and technical assistance to States and 
LEAs. " 

***** 

"It is clearly the intent of Congress that the 
goal of federally-funded capacity building pro- 
grams in bilingual education be to assist chil- 
dren of limited or non-English speaking ability 
to gain competency in English so that they may 
enjoy equal educational opportunity * * 

In the area of teacher training, OE, in fiscal year 1975, 
awarded 36 institutions of higher education a total of about 
$3.7 million to expand their bilingual education training and 
development programs. Also, 30 universities have been awarded 
480 fellowships for study in the field of bilingual education 
training with funds of about $3 million provided by OE. The 
fellowshios are awarded to master's and doctoral candidates 
to help them to train others as bilingual education teachers. 



25 



In support of the planning mandate of the law to 

EdiJlM^Lf^^-%^°''^^^^ teachers, HEW s National Center for 
Educational Statistics is making several surveys. Two in par- 
ticular are (1) a national survey to determine the size of 
the target population and its English-language proficiency and 
IZ • ^^''^^Y °f institutions of higher education to determine 

^n^inr^^^^; ^° ^^"^ retrain educational personnel 

to work with the target population. 

rnS^^^ tabulation for the national population survey of 
50,000 households was completed in January 1976. The Bureau 
of the v,ensus. Department of Commerce, made this survey as 
part of Its population survey. its purpose, in part, was to 

?h^^t!37rrr ^^^^^ °^ ^^'^^^ population, as defined by 

the ly74 Education Amendments, by age group and by language. 

.Tne Education Amendments of 1974 define oeople of limited 

nn^ H ^^'^^^^ ^= ^''^^^ "^^^ born outside the 

united States, have a native language other than English, or 

JTLmiT ^"^^^^"'"^"t "here English is not dominant and, as 
a result, have difficulty speaking or understanding English. 
A .national Center for Education Statistics official said the 
.^J^^°^the 50 ,000 household survey indicated that as many 

nfFilri "^^^^ "'"''^'^ included in the broad category 

aefmed by the first part of the amendment. He emphasized, 
however, that the survey did not show how many out of this 
population have difficulty in English; that is, are of limited 
English-speaking ability. Information on the English-language 
proficiency of the population will be obtained by the Bureau 
of the Census from a second, larger scale survey for which 
data collection is planned to begin in the spring of 1976. 

To assess the capability of colleges to train bilingual 
education teachers and other educational personnel, a 
two-phase survey of institutions of higher education has 
oeen initiated by the National Center for Education Statis- 
^u^^: o^'nL^^''^*'. P*^^^^ involved sending questionnaires to 
about 3,000 institutions of higher education to determine 
wnich have courses to prepare or retrain teachers or other 
professional and nonprofessional educational personnel to 
work with persons of limited English-speaking ability. Those 
that do will oe sent a second questionnaire (second phase) 
requesting more detailed information on the courses and pro- 
grams offered. ^ 

The first questionnaires were mailed out in October 1975* 
as of April 8, 1976, 2,953 had been returned." According to a' 
National Center for Education Statistics official, about 360 
of the institutions will be included in the second phase of 
tne survey. The second questionnaires will be sent to these 
institutions early in May 1976. 
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For school year 1975-76, OE funded, at about 
$4.7 million, nine Materials Development Centers to work on 
the development of a variety of needed instructional mate- 
rials. In addition to Spanish, French, Portuguese, Greek, 
Italian, Native American, and several Asian languages will 
be covered. Additionally, OE has funded, at about $1-5 mil- 
lion, three Assessment-Dissemination Centers to. evaluate the 
products of the Materials Development Centers. 

OE did not meet the November 1, 1975, deadline for its 
first report to the Congress on the condition of bilingual 
education in the Nation and has requested that the reporting 
date be extended to June 30, 1976. According to an OE offi- 
cial, the extension was requested because the late passage of 
the Education Amendments of 1974 (August 1974) did not give 
OE enough time to prepare a meaningful report by November 1. 

CONCLUSIONS 

OE has made little progress in achieving the program's 
goals of identifying effective educational approaches, train- 
ing bilingual education teachers, and developing suitable 
teaching materials. This situation has adversely affected 
project effectiveness and exists because OE did not establish 
an adequate management plan to insure that the goals would be 
achieved. Except for the LEAs' varied approaches, the pro- 
gram lacks the characteristics of a demonstration program. 
Rather, it has taken on the characteristics of an educational 
service program. 

OE did not formally attempt to identify approaches until 
fiscal year 1974 and only four approaches have been identi- 
fied. The effort resulting in the identification of the four 
approaches was basically an attempt to identify effective ap- 
proaches from a group of ongoing projects whose approaches 
and evaluation designs were developed autonomously and with 
little input from OE. 

OE needs a plan to systematically develop effective 
educational approaches. The plan should provide for testing 
particular approaches which are likely to work or particular 
variables which are believed to have an impact on project 
effectiveness. It should also provide for a strong evalua- 
tion design so that there will be greater assurance that the 
Dissemination Review Panel will find acceptable the project's 
evidence of effectiveness. 

Although teachers at LEA projects have received training 
to axpand and improve their capabilities, there is a national 
shortage of adequately trained bilingual education teachers; 
however, OE has neither quantified this need nor devised a 
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plan to attract and train such teachers. At the same time, 
a general surplus of elementary and secondary education 
teachers exists. Alleviation of the teacher shortage has 
also been hampered because (1) not enough colleges have 
training capacility in this field and (2) accomplishments 
o£ Federal training programs have been limited. 

OE has made considerable progress in developing and dis- 
seminating bilingual teaching materials for Spanish-speakinq 
students; however, little has been done to fill the material 
needs of pro3ects serving children who speak other foreiqn 
languages. v^icxyn 

The Education Amendments of 1974 and OE ' s program policy 
of capacity building should help develop necessary resources 

initiated action, including the necessary planning, to 
address the teacher shortage problem. Also, OE is workinq 
toward meeting the material needs of target languages othlr 
tnan Spanish. 

It will be extremely difficult to effectively expand 
Dilingual education until resources are sufficiently devpl- 
oped. This IS critical because increased numbers of LEAs 
will probaoly start bilingual programs as a result of the 
t^H V. Nichols Supreme Court decision. Under the demonstra- 
tion program concept, OE should have planned for resource 
development in the program's early stages. Because this was 
not aone, definitive action to address the problem is only now 
being initiated. 

RECOMMENDATION 

^We recommend that the Secretary, HEW, direct the Assist- 
ant secretary for Education to formulate a plan to systemati- 
cally develop effective bilingual educational approaches. 

AG EijCY COMMENTS 

_ HEW, by letter dated March 19, 1976 (see app. IV), agreed 
with our recommendation but pointed out that, until the pas- 
sage of the Education Amendments of 1974, it could not be 
effectively carried out. HEW said: 

"The GAO report suggests an activity which would 
probably be best undertaken along the lines of a 
•planned variations experiment.' While we concur 
•with this recommendation, our experience has led 
us to conclude that a grant-in-aid program (such 
as that authorized for Bilingual Education) is not 
3n e ffectiv e means for systematically developing 
and evaluating effective bilingual education 
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approaches. Generally, grant programs do not 
provide the front-end controls necessary to yield 
the results GAO is seeking. In the absence of 
explicit legislative authority, those controls 
can only be provided through contractual ar- 
rangements which, until passage of the Education 
Amendments of 1974, were not available. 



'•The Education Amendments of 1974 amended the 
Bilingual Education Act with the inclusion of a 

new Part C, Section 742. The new section au- 
thorizes a variety of contractual activities to 
be undertaken both individually and cooperatively 
by the Com^aissioner of Education and the Director, 
National Institute of Education. Given this new 
authority, a joint OE-NIE plan of action is being 
formulated for the systematic development of ef- 
fective bilingual education approaches as recom- 
mended by GAO.** 

MATTERS FOR CONSI DE RATION 
BY T HE CON GRES S 

Bilingual education was relatively new in the United 
States when the program was established in 1968, and accord- 
ingly, the Congress intended that it be a demonstration pro- 
gram. The goals of the program were sound in that, before 
committing large amounts of money and attempting to serve 
all children needing these services, effective bilingual 
education approaches should first be developed. However, 
the program has evolved into a small service program and 
little progress has been made in achieving original program 
goals. This resulted primarily because OE did not formulate 
appropriate plans to carry out the legislative objective. 

Consequently, the Congress may want to consider estab- 
lishing legislative controls over future educational demon- 
stration programs. The controls should require Federal agen- 
cies to be accountable for establishing appropriate goals, . 
objectives, and milestones, as well as assessing the program 
and reporting periodically to the Congress on its progress. 
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CHAPTER 3 

P:B2§5AM_EFFECT_ON_PARTICIPATIN 

nr^„ii^^ project evaluation reports (1) are not designed to 
provide comprehensive objective evidence of " the program's 
effect on student programs and (2) appear to be of little 

reports a?e nor^K^'^''"'-^""''^°"'""'"^^- ^1^°' ^^^^ of the 
reports are not being suomitted on a timely basis. 

n^n^J^^■^^^ projects we reviewed, some participants in- 
rP^dtnn fr^i^ "^'^ achieving at national averages in 

reading and math, but most were not. The gains of the 

n^l^^S'p^^f 'I!^ students generally surpassed those of the 
limited English-speaking students. The reliability of the 
test results, however, is questionable because the tests used 
chKd?en^^ ^ inappropriate for limited English-speaking 

Project personnel believe that students have benefited 
and°in^r'"'"r'^ self-image, improved attitudes toward school, 
cutnr. T ^PP'^^^^^tion for their native language and 
culture. Improvements m these areas should result in better 

g^'n^'r^lVfavora'bleV ^° ^'^'^^^ 

NEED_j;;OR_IMPROVED_LEA_PROJE^ 

LEA project evaluation reports are the only source of 
'^^g^'^ding students' academic progress and serve 
?hese r.noif^ identifying projects worthy of replication. 
HP hL ^ ''^''^ m design and quality because 

AS a rP^nir ^h""" J^^^^^^^^^ble latitude in their preparation. 
AS a result, they have been inadequate for measuring program 
llll^ °" ^"""f achievement, and, as discussed in chapter 2, 
plication ^"^^^'5^^*'^- fo'^ identifying projects worthy of re- 

££2iggt_evaluati on des igns 

The inadequacy of local project evaluations has been 
known for some time. For example, HEW's fiscal year 1974 
annual evaluation r<^port on programs administered by OE 

"* * * the only current source of data concern- 
ing the program's impact on children are the 
annual individual project evaluation reports 
whose limitations in the data or methodologies 
prevent them from being used to draw conclusions 
about overall program effectiveness." 
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Program regulations specify that an annual evaluation 
should be made for each project but give the projects much 
latitude in the types of behavior to measure, instruments 
to use, data to collect, and analyses to make. Within these 
general considerations, projects can use whatever evaluation 
design they believe appropriate. The regulations require 
LEAs to submit reports which include reliable, valid, or 
other objective measurements of project success at least 
twice a year. LEAs can select the subjects to be tested 
and the tests to use. 

Of the 16 projects we reviewed, 2 did not submit evalua- 
tion reports to OE for school year 1972-73. 1/ The" reports 
of the remaining 14 projects generally: 

— Included much statistical data from various tests, 
both standardized and project developed, which were 
presented in different formats making comparisons 
between projects difficult. 

— Attempted to measure progress in achieving goals, 
few of which were stated in measurable terms, such as 
rectifying unequal education opportunities, improving 
reading ability, and developing self-confidence. 

— Contained a minimal amount of Information on the na- 
ture, strengths, and weaknesses of classroom activi- 
t ies . 

The Congress and OE assert that the program intends 
eventually to make students of limited English-speaking 
ability proficient In English, and, in the interim, have^ 
them make normal progress in school through instruction in 
their dominant language. However, for school year 1973-74 
project goals varied and occasionally did not address program 
goals . 

There was often disagreement among school officials, 
teachers, and aides as to whether the primary program goals 
should be to (1) Improve the students' ability in English and 
other basic skills such as math, (2) enhance the students' 
self-image, or (3) stimulate the students* awareness and un- 
derstanding of the two cultures. The stated goals of some 
of the projects were to improve the students* confidence and 
self-image and to instill pride in their native culture. At 
six projects, the stated goals made no reference to the par- 
ticipants' academic achievement. Additionally, the LEAs 



1/Evaluation reports for school year 1972-73 were the most 
current reports available at the time of our fieldwork. 
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generally did not establish measurable performance objectives. 
The difficulties LEAs have had in assessing English language 
"proficiency is discussed in chapter 4. 

Usefu l nes s of reports fo r Federal 
and local deci sionmakinc? 

Several sources have concluded that individual project 
evaluation reports have limited use for Federal and local 
officials. For example, an educational research laboratory 
studied the impact title VII project evaluation reports have 
on local and Federal decisionmaking. After reviewing re- 
ports from 42 projects and discussing them with program 
administrators at both levels, the laboratory's report, 
issued in 1974, concluded that the evaluations were of little 
use to local and national management. In another OE-financed 
study completed in 1973, the contractor concluded: 

"The study team could not easily assess the 
qualitative use of evaluation results either 
in planning or in day-to-day operations, be- 
cause evidence of evaluation report utility 
was not extensively do.cumented . " 

Project directors at all but three projects we reviewed 
expressed some displeasure with the reports. The most fre- 
quent problem was that evaluators either made no recommenda- 
tions or made unrealistic recommendations that were of little 
use. Others said the evaluations were not comprehensive. 
Most teachers interviewed said (1) they either had not re- 
viewed the reports or had not been told of their contents 
and (2) the project evaluators had not visited their class- 
rooms. Consequently, not only were most project directors 
dissatisfied with the reports, but the teachers responsible 
for implementing the changes were usually unaware of the 
recommendations made. 

Ten project directors and 10 evaluators acknowledged 
that OE needs to develop more specific evaluation instruc- 
tions to elicit more consistent, useful evaluations. They 
said that evaluations would be improved if OE indicated the 
academic subjects to be tested, suggested which test instru- 
ments to use, and specified a format for presenting test 
scores. 

Rep9gts not submitte d 
on a timely basis 

In December 1974 we attempted to review project evalua- 
tion reports for school year 1973-74. At that time, however, 
only six projects included in our review had submitted their 
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reports. According to an OE official, the reports were due 
in July 1974, but about two-thirds of all title VII projects 
had not submitted them as of December. 

APPROP RIATENESS OF 
ST ANDARDIZE D TESTS 

OE officials said that the lack of appropriate test in- 
struments for the target population has inhibited the collec- 
tion of consistent, comprehensive achievement data. Several 
studies have indicated that standardized achievement tests 
being used by most schools were developed primarily for anglo 
middle-class children and are biased against limited English- 
speaking children, both 1 inguistically and culturally. Con- 
sequently, these tests may not always indicate what students 
learned or how they compared to national averages. Project 
directors and evaluators we interviewed agreed with this 
viewpoint . 

Although this problem has been widely recognized for 
years, little has been done to alleviate it. OE funded a 
national project in 1971 to do research and develop tests 
to measure a child's cognitive skills; that is, skills such 
as reading and math. During school year 1973-74, the project 
completed three tests designed to measure a child's learning 
abilities. However, they are not achievement tests. Con- 
sequently, although these tests should help teachers and LEA 
project directors to determine a student's individual needs, 
the tests' results will not provide OE with achievement data 
to gauge the program's effectiveness. 

NATIONAL IMPACT STUDY 

OE's contract for the national impact study is scheduled 
for completion in November 1976. The purpose of the study is 
to assess the program's effect on children's cognitive, affec 
tive, 1/ and behavioral domains. The children's progress in 
Spanish-English title VII schools will be compared with that 
of children not enrolled in the program. Achievement and 
other tests will be administered in school year 1975-76, en- 
abling the contractor to analyze student development over 
1 year. Reading and nath tests will be given in English and 
Spanish. The contract also contains an option for a longi- 
tudinal analysis, but the decision to continue the evalua- 
tion over 2 or 3 years will be made at a later date. 



1/The affective domain involves changes in the feelings, 
emotions, values, and personality of the child. 
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M§ULTS_OF_OUR_ANALYSES 

At each project we randomly selected 100 English and 
non-English dominant participants and analyzed appropriate 
school records to determine their progress regarding academic 
achievement, attendance, grade repetition, self-image, and 
cultural appreciation. We also interviewed school officials, 
teachers, and parents to obtain their views on the projects' 
merits and effect on the students. 

We relied on English reading and English math tests 
given by the LEA as part of the regular school or title VII 
testing program. Two analyses were made: a 1-year analysis 
of the students' academic achievement in school year 1973-74 
and a longitudinal analysis of their progress over 2 years. 
We also attempted to (1) compare achievement levels of our 
sample with a group of nonparticipants, (2) make a 3-year 
longitudinal analysis, and (3) determine progress by compar- 
ing achievement levels before participation with achievement 
levels after participation. However, lack of control groups 
and test data over 3 years precluded us from making these 
latter analyses. 

Academic progress f or 1 yea r 

Our analysis was made to determine the (1) average 
achievement gain for each project, (2) number of students 
making normal progress, and (3) students' achievement com- 
pared to "normal" expectations for their grade levels. Raw 
scores from standardized tests can be converted to grade 
equivalent scores reflecting rrational norms, which are pro- 
vided by the test publisher based on a nationwide sampling 
of students. In addition to national norms, test publishers 
provided "expected" scores, which indicate scores students 
should attain to be equal with their peers at each grade 
level. Publishers define normal progress as a 1-month achieve- 
ment gain for each month of enrollment. 

The following chart shows average gains per project made 
by 895 sample students in reading and 551 sample students in 
math. The figures represent the average gains per month, 
with normal progress being 1.0. Fourteen projects adminis- 
tered standardized tests in school year 1973-74; the tests 
and testing interval varied. However, data could not be ob- 
tained on the entire sample of 100 students at each project 
because some LEAs did not include all students in the test- 
ing program and because of student absenteeism and mobility. 
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Average Gains by Pr oject (note a ) 
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a/Where no figures are shown, it is because either the students 
were not tested or the scores could not be converted to grade 
equivalents . 

There were wide differences in reading and math achieve- 
ment among the projects. At three projects (G,.H, and K) 
both English-dominant and non-English-dominant students showed 
substantial progress in both subjects. However, at several 
other projects the students, on the average, made less than 
normal gains. The recorded scores at projects H and K were 
based on tests for grades lower than the actual grade level 
of the students. For example, non-English-dominant third 
grade students were given second grade tests. Project of- 
ficials said that the lower level tests were given because 
they were considered more appropriate for limited English- 
speaking students. 

We also made analyses of test data by grade level. The 
following graphs show the number and percentage of English- 
dominant and non-English-dominant students making normal pro- 
gress and achieving at expected levels in both reading and 
math. The data represents students in our sample at all 
projects. 
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GRADE 



NUMBER AND PERCENTAGE OF STUDENTS BY GRADE 
MAKING NORMAL PROGRESS (note a) 
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^ Normal progress is 1 month gain in achievement for each month of enrollment. No percentages ore shown forgrade 
) or for limited English speaking students in grade 6 due to the limited amount of dota available. 
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The major findings of these analyses are: 

--Overall, about half of the English-dominant students 
(343 of 662) made at least normal progress in both 
reading and math. Only one-third of the non-Enalish 
dominant students (151 of 426) progressed normally 
in reading and less than half (157 of 341) made normal 
progress in math. 

— The gains of the English-dominant students generally 
exceeded those of the non-English-dominant students 
in both reading and math. . 

--Both groups generally fell further behind expected 
grade levels in the higher grades. 

We could not conclusively identify the variables which 
explain the difference in student achievement at the projects. 
However, several factors, such as questionable classroom ap- 
proaches and shortage of bilingual education teachers, seem 
to affect the scores. (See ch. 4.) For example, at project 
A only 6 of 18 project teachers were bilingual and the non- 
English-dominant students received their classroom instruc- 
tion primarily in English. Project D did not have sufficient 
instructional material which caused lower auality classroom 
instruction according to project officials.^ Another factor 
precluding identification of variables affecting project 
success was that a wide range of tests were used.. 

Of the 16 projects, G, which evidenced higher than nor- 
mal test scores, perhaps had done most to marshal the re- 
sources needed to implement effective programs. For example, 
it (1) extensively used Spanish Curricula Development Center 
material, (2) had a full complement of bilingual teachers and 
teachers aides, (3) had a strong staff development component, 
(4) had clearly established goals and objectives, and (5) ap- 
peared to be well managed. 

We reviewed school year 1973-74 project evaluation re- 
ports to compare our analyses of student achievement with 
that reported by the LEAs. Only six projects we reviewed 
had submitted annual evaluation reports. Of the six, only 
two reported test data which adequately indicated the 
academic achievement of the participants. One project showed 
that, on the average, target children were progressing at 
rates higher than English-dominant children. The other 
project showed that, generally, the non-English-dominant 
children were not doing as well as the English dominants. 
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Longitudinal achievement analyses 



Longitudinal analyses enable the evaluator to measure a 
student's progress continuously for periods over 1 year, 
rather than only at the end of each year. Unfortunately, 
such analyses are inhibited by two factors. First, students 
frequently do not remain in one LEA for more than 1 or 2 
years. We were able to obtain longitudinal reading test 
data on 396 students and math test data on 276. Second, if 
LEAS change tests from year-to-year, comparison of test 
scores becomes extremely difficult. 

The problem of comparing scores from different tests 
can be partially resolved by using the results of the 
Anchor Test Study. This study, performed under an OE con- 
tract and completed in September 1974, resulted in new grade 
equivalent norms for eight commonly used reading tests for 
students in grades 4, 5, and 6. Appropriately, this allows 
for test scores to be compared among all eight tests in these 
grades. 

The chart below shows the results of our longitudinal 
analysis of students who made normal progress or better dur- 
ing school years 1972-73 and 1973-74. 

N umber and Percentage of Students M aking 
Nor;m al Progre ss or Better 
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dominant 


Grade 


Number 


Percent 


Number 


Percent 


2 


0 


0 


6 


32 


3 


20 


47 


17 - 


30 


4 


24 


69 


18 


32 


5 


24 


56 


5 


56 


6 


_5 


71 


_5 


93 


Total 


73 


57 


51 


35 
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The analysis showed that 85, or 45 percent, of 191 
English-dominant students and 67, or 33 percent, of 205 non- 
English-dommant students made normal reading progress or 
ofnH^n; ^^"'f?''' "^^^c^" ^"^ percent, of 129 English-dominant 
^^nnfn^^ ^? percent, of 147 non-English-dominant 

students achieved at least normal progress. Thus, gains 
made by English-dominant students on the average were better 
than those of non-English-dominant students. Also, a com- 
parison of the longitudinal results with the 1-year analysis 
shows that students generally did not achieve as high a rate 
of growth over the 2-year period as they did in 1 year. OE 

^n'nn^i^ ^^f^ ^"^^ regression of this nature is common in 
all compensatory or remedial educational programs. 

At each of the 16 projects, we interviewed 20 parents 
tor a total of 320. The parents were asked how they thought 

Fno^? = h^'f?^''^'^•f"^''^^'^ children's ability to (1) speak 

English, (2) write English, and (3) learn mathematics. The 
responses were favorab]e; 86, 75, and 80 percent, respec- 
tively, said they were satisfied with their child's progress. 
The parents of English-dominant students were somewhat less 
satisfied than parents of the limited English-speaking chil- 
dren. Detailed parent responses are shown in appendix III. 

Other i n d icato rs 
2 f _ P£°L3£^iI}_J:J]lP act 

Although OE officials consider academic growth to be the 
primary indicator of program success, thev believe success 
should also be predicated on four other indices— changes in 
the students' self-image, cultural understanding, attendance, 
and grade repetition. 

The vast majority of teachers and aides we interviewed ■ 
said that the program has had a positive impact on students- 
self-image and cultural understanding because the students 
felt more comfortable using their native language. However, 
little objective evidence, such as tests, questionnaires, or 
surveys, was available to support this contention. About 
65 percent of the parents interviewed believed that their 
children's attitude toward school had improved since begin- 
ning the program, and 60 percent felt attitudes of their 
children in the project were better than the attitudes of 
their nonpartic ipating children. 

During school years 1971-72 through 1973-74, the attend- 
ance of students in our sample improved at five projects, 
worsened at one, and remained the same at three. Three-year 
attendance data was unavailable at the other seven projects 
Students' attendance was better than school or LEA averages 
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in seven caseSr worse in one, and about the same in four 
LEAs. Because of the lack of this data and because several 
factors can influence attendance, we could not conclude 
whether the program has had a positive influence on students' 
attendance . 

Grade repetition data for sample students was available 
at 12 of the 16 projects. At seven projects less than 5 per- 
cent of the students had to repeat a grade and at the other 
five the retention rate varied from about 7 to 36 percent. 
At four of the five LEAs which computed grade repetition 
averages, sample students compared favorably to nonpartici- 
pants. However, many LEAs retained students only under excep- 
tional circumstances. Thus, our data is inconclusive because 
the incidence of grade repetition can be more a function of 
LEA policy than a reflection of program impact. 

CONCLUSIONS 

OE does not know whether the program is meeting the 
special educational needs of the target population because 
LEA evaluations are not designed to provide comprehensive 
objective evidence of the program's effect on participants. 
Further, the test Instruments being used by most schools 
for the carget population are not an accurate indicator of 
acadmeic progress because they are probably biased against 
limited English-speaking children, both linguistically and 
culturally . 

LEA project evaluation reports are the only source of 
data on students* academic progress. However, because OE 
has given LEAs considerable latitude in developing evalua- 
tion designs and preparing evaluation reports, their useful- 
ness for assessing overall program impact is extremely 
limited; the variances in quality and content are great. 
Also, as discussed in chapter 2, poor evaluation designs 
have seriously hampered OE*s progress in identifying effec- 
tive bilingual educational approaches for dissemination. 
OE needs to take action to strengthen the evaluation designs 
used by LEAs and the corresponding evaluation reports. 

Timely evaluation reports are basic to effective Federal 
and local level management so that adjustments affecting proj- 
ect implementation can be made. Evaluation reports, however, 
are not being prepared on a timely basis. Many projects were 
well into the following year of funding but still had not 
submitted evaluation reports for the preceding school year. 
OE needs to aggressively implement the program requirement 
that LEAs submit evaluation reports on a timely basis. 
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The national impact evaluation currently being done 
under contract for OE may provide useful information of the 
program's effect on participants. However, the study does 
not negate the need for an improved management information 
system which would routinely provide OE with data necessary 
to periodically evaiuat- the program and to increase the 
likelihood of identifying projects worthy of dissemination. 

At the 16 projects we reviewed, the target children were 
receiving educational services and benefits that they other- 
wise might not have received. Available test scores indicated 
that some program participants made normal progress in reading 
and math, but most students did not achieve at rates compar- 
able to national averages. However, as previously stated, the 
reliability of the test results is Questionable because the 
test instruments used are probably inappropriate for limited 
English-speaking children. OE needs to make a concerted ef- 
fort to identify and, if necessary, develop appropriate test- 
ing instruments. No objective evidence was available, but 
project personnel believe program participants have enhanced 
self-images, improved attitudes toward school, and increased 
appreciation for their dominant language and culture. 

RECOMMENDATIONS 

We recommend that the Secretary, HEW, direct OE to: 

— Require LEAs to establish (1) specific project goals 
consistent with the intent of title VII and (2) clear, 
measurable performance objectives to achieve the goals. 
To be consistent with program intent, project goals 
and objectives should address the levels of progress 
desired for the participants in English proficiency 
and academic achievement in both English and the other 
language . 

— Expand and improve the OE management information sys- 
tem so program managers have uniform, consistent data 
needed to evaluate and manage the program. The ex- 
panded system should be designed to provide the data 
to assess the effect iveness of the program and each 
title VII project. To accomplish the needed improve- 
ments, program regulations should be revised to 
specify minimum requirements for LEA evaluations, in- 
cluding (1) reporting format, (2) academic subjects 
to be evaluated, (3) analyses to be made, and (4) an 
external standard, such as a control group, for com- 
parison purposes. 
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— Take steps to aggressively implement the program 
requirement that LEAs submit evaluation reports on 
a timely basis. 

— Examine the appropriateness of testing instruments 
available for children with limited English-speaking 
ability and, if needed, take action to have better 
ones developed at the earliest possible date. 

AGENCY COM MENT S AND OUR EVA LUATION 

HEW concurred in our recommendations and said that: 

— The draft program regulations (published for comment 
in the Federal Register on April 8, 1976) require 
that an applicant's evaluation design include provi- 
sions for (1) assessing the applicant's progress in 
achieving the objectives set out in its application 
and (2) comparing the performance of participating 
children on tests of reading skills in English and 
in the language other than English to be used in 
the proposed program. 

JO improve its management information system, the 
draft regulations require that program participants 
be tested in reading skills in two languages, that 
their performance be compared with control data, and 
that such comparisons include tests of statistical 
significance. A reporting format will be suggested 
to the project directors and OE's Office of Bilingual 
Education will extract data from individual project 
reports to determine total program effectiveness. 

— Projects will be notified of the requirement to sub- 
mit evaluation reports in writing at least 3 weeks 
before the deadline date. If this procedure is not 
productive, additional followup will be made by OE 
program officers. Further, projects funded over 
more than 1 year must submit periodic evaluation 
reports as a condition for funding beyond the first 
year . 

— Draft program regulations establish a network of OE 
support services specifically directed toward iden- 
tifying appropriate instruments for measuring the 
educational performance of children with limited 
English-speaking ability and assessing the need for 
such instruments and their appropriate use in bilingual 
education programs. In close coordination with OE, 
the National Institute of Education is supporting the 
development of assessment instruments for reading 
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in Spanish and in fiscal year 1976 will support a 
critical analysis of existing instruments across 
different languages, content areas, and grade levels. 
This analysis will assist in identifying areas where 
new instrument development is needed. 

The action proposed by HEW should help to improve the 
usefulness of its management information system in assessing 
overall program impact on student achievement. We believe, 
however, that stronger and expanded reporting requirements 
will be needed to provide uniform information on the program 
goals established by the Congress. 

The legislation states that a "program of bilingual 
education" means a program of instruction which (1) provides 
for the study of English and "(2) allows a child to progress 
effectively through the educational system. To achieve the 
latter goal, the legislation states that such instruction 
shall be given, to the extent necessary, in the native 
language of the limited English-speaking children with ap- 
preciation for their cultural heritage. The legislation 
further elaborates that instruction at the elementary school 
level shall be given in the native language, to the extent 
necessary, in all cour ses or subjects of stud^ with the ex 
ception of art, music, and physical education. 

The proposed program regulations require that projects 
evaluate participants' reading performance both in English 
and in their native language. These results, although cer- 
tainly important, fall significantly short of obtaining re- 
sults on the total program of instruction that is mandated by 
the legislation. 

HEW said a uniform reporting format will be suggested to 
the projects. With this approach, it can only be hoped that 
projects will accept the suggestion. In view of the import- 
ance of uniform reporting in making an overall program assess- 
ment, we believe that specific reporting formats should be 
requ ired and not merely suggested. 
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CHAPTER 4 

FACTORS AFFECTING STUDENT ACHIEVEMENT 



At the projects we reviewed there were two particular 
factors which might have adversely affected the academic 
achievement of limited Engl ish--speak ing children. 

— The dominant language of the limited English-speaking 
children might not have been used enough for class- 
room instruction. 

— There often seemed to be too many English-speaking 
children in the project classrooms, thereby diluting 
program services for the limited English-speaking 
ch ildren. 

Another factor adversely affecting program effective- 
ness is that projects are having difficulty in accurately 
assessing the English language proficiency of the target 
population. Additionally, OE has not adequately monitored 
LEAs' progress in meeting program goals. 

LANGUAGE OF LIMITED ENGLISH-SPEAKING 
CHILDREN NOT USED ENOUGH 

In a bilingual education program, a child's dominant 
language should be used enough to allow effective progress 
through school. Nine projects we reviewed were providing 
instruction in the dominant language of the target popula- 
tion less than 30 percent of the time. Average reading 
and math scores for the children in these projects were 
somewhat lower than those of similar students who received 
more instruction in their dominant language at the other 
seven projects. 

The legislation characterizes a bilingual educat ional 
program as having three key ingredients: (1) instruction 
In, and study of, the English language, (2) use of the 
"other" language to teach all subjects necessary for ef- 
fective school progress, and (3) instruction in the child's 
cultural heritage. Implementing such a program entails 
providing instruction in the dominant language to the ex- 
tent necessary until the child can be taught in English. 

Initial program guidelines, in effect during school 
year 1973-74, suggested that LEAs consider using any of 
three alternative approaches — equal time for both languages, 
instruction emphasizing the child's dominant language, or 
a strong Engl ish-as-a-second-language program. OE offi- 
cials acknowledged that the latter approach should not 
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have been suggested. All 3 approaches were in evidence at 
the 16 projects we reviewed. 

We observed two classes per grade level at each project 
to determine the instructional approar^tt— and the extent to 
which English and the other language were used in teaching " 
English- and non--Engl ish--dominant students. Time spent for 
physical education, lurjch, recess, etc., was not considered. 
The following table sunimar izes our observations, and shows 
that, on the average, about twice as much time was devoted 
to academic instruction for English-dominant students in 
English as was devoted to teaching academic subjects to 
non-English-speaking students in their dominant language. 
For example, fourth grade English-speaking students re- 
ceived 71 percent of their academic instruction in English 
while. non-English-dominant students received only 32 percent 
of their academic instruction in their dominant language. 



Non-English-dominant s tudents 
Instruct ional t ^?g_ ^££L^i^[^^2II 
SiMi (A) (B) (C) TotaJ. 

, ^ percent ) 

K 35 23 42 100 

1 39 25 36 100 

2 41 24 35 

3 39 30 31 

4 37 31 32 

5 30- 35 35 

6 29 .^25 36 



100 
100 
100 

35 100 
lOU 



ysh-domi nant^stjjdents 

(A) (B) (C) Total 



■(percent)- 



^ 16 67 17 loo 

^ ^6 74 l-O 100 

.r 73 9 J 00 

i 19 73 8 100 

? IJ 71 10 TOO 

^ 15 65 20 TOO 

6 28 64 , 8 100 

Sec^^nd-languaqe i nc.ruction; f( r examole, Soai.ish for 
Engl i.^:h-r-.peaKinq st 'jof.nts . 

Acaaenac subjects t,r,qht m nnqlish ( ma th , " sr i r-nce , 
nio'tory, art, language artv, etc.). 

Ac^aemic subjects Laugh! in the do.ninant lancj-ie of 
the non~f nglinh-cp. a'kinq, s^ jdents. 
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Some specific examples highlight the' fact that non-- 
English-speaking students do not appear to be getting enough 
instruction in their dominant language. Spanish-dominant 
kindergarten students at one project were taught in Spanish 
only 19 percent of the time. Second grade limited English- 
speaking students at another project received only 17 per- 
cent of their instruction in Spanish. Consequently, students 
identified on class rosters as non-English dominant, who sup- 
posedly learn better in another language, are nonetheless 
being taught primarily in English. 

We also observed that in 9 of the 16 projects, non- 
English-dominant students in the majority of grades received 
more than 70 percent of their instruction in English and 
these students generally did not do as well as non-English 
speakers in the other 7 projects. Of the 12 projects having 
reading scores, non-English-speaking students at 5 of the 7 
projects with the highest scores^ece ived more than 30 per- 
cent of their instruction in a language other than English. 
Conversely, four of five projects with the lowest reading 
scores provided their non-English-speaking participants' 
instruction in English more than 70 percent of the time. 
For the nine projects having math scores, three of the top 
four provided their non-English-speaking students more 
than 30 percent of their instruction in a language other 
than English. 

Another analysis of the data shows that in reading, 
2^09 non-English-speaking students receiving more than 30 
percent dominant language instruction made an average gain 
of 1.03 months compared to an average gain of .88 months 
for 198 students receiving more English instruction. In 
math, the average gain for 175 rion-Eng 1 ish-speaking students 
receiving more dominant language instruction was 1.03 months 
compared tf-o an: average gain of .95 months for 177 students 
receiving more English instruction. 

Eight of th-e- nine project directors acknowledged that 
the students ' dominant language was not used enough . Although 
various reasons were said to contribute to the problem, seven 
directors told us that the lack, of adequately trained bilin- 
gual education teachers was a m;ajor cause. Two directors 
said that inadequate OE guidelines also contributed to the 
problem . . 

NEED TO LIMIT PARTICIPATION 
OF E NGLISH-SPEAKING STUDENTS 

Original, program regulations allowed English-dominant 
students to participate in the program. The Education 
Amendments of 1974 also make this provision and state: 
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"A program of bilingual education may make provi- 
sion for the voluntary enrollment to a limited 
degree therein, on a regular basis, of children 
whose language is English * * *. in determining 
eligibility to participate in such programs, 
priority shall be given to the children whose 
language is other than English." (20 U.S.C. 
§ 8806-l(a) (4) (B) ) 

However, neither the legislation nor the regulations specify 
acceptable classroom ratios of English- to non-English- 
dommant students; consequently, program services have been 
diluted. r f 

At 10 projects we reviewed, all classes at each grade 
level participated in the program. The enrollments of 
English-dominant children ranged from 85 to 7 percent as 
shown below. 



Proj- 


Grades 


students 


ect 


covered 


Number 


Percent 


E 


K-4 


166 


85 


B 


K-1 


84 


78 


li 


K-6 


910 


74 


M 


K-5 


476 


70 


J 


1-4 


119 


63 


I 


K-5 


422 


55 


C 


K-2 


167 


47 


P 


K-6 


116 


39 


N 


1-4 


59 


36 


0 


K-4 


73 


7 



Non-Engl ish- 
dominant 

stude nts 

Number Percent 



29 
24 
328 
207 
69 
339 
190 
184 
105 
000 



15 
22 
26 
30 
37 
45 
53 
61 
64 
93 



Total 
project 
enrollment 

195 
108 

1,238 
683 
188 
761 
357 
300 
164 

1,073 



The problem created for LEA management by serving total school 
populations is how to effectively assign students to project 
classrooms. If there are many more English-dominant partici- 
pants, the effect is to spread non-English-dominant students 
and project resources among many classrooms, rather than con- 
centrating program services on the neediest students. 

There were many classrooms at the 10 projects which had 
significantly more English-dominant than non-English-dominant 
students. However, each project had at least two classrooms 
per grade level and it would have been possible to achieve 
high concentrations of non-English-dominant students by re- 
ducing the number of project classes. The examples below 
show classroom assignments for these students covering one 
grade level each at five projects. • 
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Classroom 



First Second Third Fourth 



Proj- 


Grade 




Non- 




Non- 




Non- 




Non 


ect 


level 


Eng . 


En^. 


Eng. 


Eng . 




Eng . 


Eng . 


Eng 


E . 


2 


19 


1 


18 


5 










J 


1 


18 


8 


22 


6 










B 


1 


19 


6 


18 


2 


8 


8 






H 


4 


32 


2 


28 


7 


12 


4 






I 


4 • 


6 


10 


18 


6 


20 


9 


22 


3 



Where small concentrations of non-English-dominant stu- 
dents are spread across several classrooms , an LEA should as- 
sign these students to fewer classes, but still allow some 
Engl ish-dom i nan t students to par t ic ipate • LEAs could then 
concentrate more resources — financial, human, and material — 
on target students, which is critical considering teacher and 
materials shortages. (See ch. 2.) By limiting the number of 
English-speaking participants in some way, OE would also 
achieve the most effective use of program funds. Of the 10 
projects shown on page 48, 6 had fewer non-Engl ish-dominan t 
than English-dominant students (projects B, E, H, I, J, and 
M) and seemingly would benefit by limiting the number of 
English-dominant participants . 

PROBLEMS IN DETERMINING 
ENGLISH LANGUAGE PROFICIENCY 

The LEAs we reviewed had difficulty in assessing the 
English language proficiency of the target population. Proper 
assessments are necessary for (1) LEAs to design effective 
projects, (2) evaluators to properly measure project progress, 
and (3) OE to make well-informed funding decisions. 

Three LEAs used the student's surname as an indicator, 
and most of the other 13 LEAs used a combination of factors, 
including Bureau of Census data, language the child spoke 
best in school, and language the parents spoke at home. 

Educators generally recognize that one's surname is 
not an accurate language-dominance indicator. Further, OE 
and project officials said that many factors must be analyzed 
to determine a child's language dominance and that this can 
best be done by using some type of test or index. OE offi- 
cials told us that some language proficiency tests are avail- 
able, but comprehensive information on' their adequacy is not. 

. MONI TORING ACTIVITIES 

Effective project monitoring by OE is instrumental to 
the management process, particularly in identifying program 
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weaknesses, recommending solutions, and insuring compliance 
with program intent. OE, however, has not sufficiently 
monitored the program primarily because a formal monitoring 
system, with the necessary manpower, has not been established. 
Many of the problems cited earlier in this report, especially 
those concerning project justification and direction, might 
have been mitigated had OE adequately monitored local activ- 
ities. 

OE^s monitor ing efforts 

OE's monitoring activities include reviewing project 
applications and evaluation reports, as well as making on- 
site visits. LEAS are responsible for managing project acti- 
vities to insure proper and efficient program operation. As 
discussed previously, project applications and evaluation re- 
ports have not contained accurate and sufficient data to make 
informed decisions regarding project progress. Lacking this 
control, OE has had to rely on visits to LEAs to correct 
problems . 

During fiscal years 1973 and 1974, OE had 8 program of- 
ficials responsible for monitoring over 200 projects. These 
officials did not have adequate guidance for making monitor- 
ing visits, such as (1) frequency of visits, (2) project 
activities and records to review, and (3) feedback to pro- 
vide project staffs. In addition, the workload of the pro- 
gram officials made it difficult to accomplish this function. 
Each official was assigned between 17 and 35 projects but 
they also had other duties, including negotiating budgets, 
preparing administrative reports, and reviewing project fi- 
nancial, transactions. OE officials said that routine project 
visits could not be made. 

Of the 16 projects we reviewed, 2 had been visited more 
than once, 9 had been visited once, and 4 had not been visited 
at all since their inception. No data was available for one 
project. Project directors said that during their, visits, 
OE monitors reviewed project records, talked with project 
directors and teachers, and observed some classrooms. How- 
ever, followup was not provided to insure that any observed 
shortcomings were corrected. Project directors believed 
more frequent visits would have been beneficial in strengthen- 
ing their programs, particularly in the early stages of proj- 
ect development. 

2^_^£t i o n_ to_s t r engt hen 
monTtorTng activities 



For fiscal year 1975, the number of program officials 
responsible for monitoring projects was increased from 8 to 
11, and emphasis was placed on monitoring new projects. An 
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OE official told us that 135 first-year projects were visited; 
other projects were not visited because of staffing limita- . 
tions. Also, to assist project monitors, a monitoring guide 
was developed. The guide provides direction on such matters 
as (1) program areas to be covered during visits, (2) prepara- 
tion of monitoring reports, and (3) preparation of letters to 
projects stating the project monitor's findings and recommenda- 
tions. 

In fiscal year 1976 the number of project monitors was 
increased from 11 to 14 and monitoring priorities were re- 
fined. Four basic priorities were established with the 
highest priority given to those projects believed to be in 
the greatest need of help and/or new projects which seem to 
have had difficulty in getting irnderway. 

Although the number of project monitors has nearly 
doubled in 2 years (from 8 to 14), there also has been a cor- 
responding increase in the number of projects to be moni- 
tored (from 209 to 380 ). Consequently, even though pr^iorities 
have been established and a monitoring guide developed, it 
appears that the monitoring staff will continue to have a 
s izeable workload . 

CONCLUSIONS 

Children of limited English-speaking ability might not 
be doing as well academically as English-speaking children 
because (1) not enough instruction is given in their domi- 
nant language and (2) too many English-speaking children are 
often put in bilingual education classrooms. Insufficient 
instruction in the dominant language of the limited English- 
speaking child appears to be due primarily to the lack of 
qualified bilingual education teachers. The presence of 
s ign if icant numbers of English-speaking students resulted 
primarily because OE did not establish limits on the number 
of these children allowed to participate. While there are 
benefits to be derived from having Engl ish-speaking children 
participate, their numbers should be limited in some way so 
that available program services are concentrated on the 
target populat ion. 

The LEAS had difficulty in accurately assessing the 
English language proficiency of the target population. Ac- 
curate assessments are needed for (1) LEAs to design ef- 
fective projects, (2) evaluators to properly measure * project 
progress, and (3) OE to make well-informed funding decisions. 

The most reliable way of assessing English language pro- 
ficiency appears to be through the use of a testing instru- 
ment. Some instruments are available but comprehensive 
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information on their adequacy is not. Available instruments 
should be examined for appropriateness, and action taken to 
have better ones developed, if necessary. 

OE's project monitoring activities have been insufficient 
to insure appropriate program implementation. Many problems 
cited in this report could, have been mitigated if OE had ef- 
fective monitoring activities; particularly where new projects 
have been established. In fiscal years 1975 and 1976 OE took 
action which should help to strengthen project monitoring. 
However, it appears the gains to be realized by staff increases 
will be largely offset by the increased number of projects. 

RECOMMEN DAT IONS 

We recommend that the Secretary, HEW, direct OE to: 

Establish classroom limits on the number of English- 
speaking participants, or use other methods which 
will provide added assurance that available program 
resources will reach the largest possible portion of 
the target population. 

— Examine the appropriateness of available testing in- 
struments for assessing English language proficiency 
and, if needed, take action to have better instru- 
ments developed. 

AGENCY COMMENTS 

HEW generally agreed with our recommendations and said 

that: 

— Through careful review of applications and increased 
monitoring, OE is confident that it can assure an 
appropriate balance among participating children. 
The specific question of limitations will be reviewed 
during the comment period on the proposed regulations. 

— OE, among other things, has developed a network of 
support centers for bilingual education that will 
be identifying, collecting, reviewing, developing, 
and disseminating appropr iate language proficiency 

. assessment materials. Working closely with OE, the 
National Institute of Education in fiscal year 1976 
is researching several areas, including the consis- 
tency and accuracy with which alternate assessment 
procedures identify children in need of bilingual 
programs\within language groups. The findings of 
this investigation will be used, in part, to deter- 
mine the need for developing additional assessment 
procedures . 
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CHAPTER 5 



SCOPE OF REVIEW 



We evaluated the effectiveness of the Bilingual Educa- 
tion Program in developing effective bilingual educational 
approaches, adequately trained bilingual eduation teachers, 
and suitable instructional materials. Also, at 16 projects 
we determined the program's impact in meeting the special 
educational needs of a sample of limited English-speaking 
children. 

At OE headquarter s in Washington, D.C., we interviewed 
officials responsible for administering and evaluating the 
program and reviewed policies, regulations, practices , and 
procedures established for program administration. We also 
examined program evaluation repor ts , including those pre- 
pared by OE and private firms under contract to OE, 

Of the 20 projects we reviewed, 16 were implemented at 
LEAs to provide educational services to limited English- 
speaking students and 4 were established at LEAs to develop, 
acquire, and disseminate instructional materials and test 
instruments for national use. At each project we examined 
project applications, records, and reports, and interviewed 
project officials. At the 16 projects providing classroom 
services, we also interviewed school administrators, teachers 
teachers' aides, and made classrooin observations. We also 
analyzed test data to evaluate the academic progress being . 
made by a selected group of students. The 16 projects were 
located in Arizona, California, Colorado, Louisiana, Massachu 
setts, Montana, New Mexico, New York, and Texas, as shown 
in appendix I. 

We used questionnaires to obtain pertinent information 
from State education agencies, colleges with accredited 
teacher training programs, and parents of children partici- 
pating in the Bilingual Education Program. 

Our fieldwork was completed in the summer of 1974. Work 
at OE headquarters was essentially completed in th^ fall of 
1975. 
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SCHOOL YEAR 1973-74 CHARACTERISTICS OF 
BILINGUAL EDUCATION PROJECTS C^AO REVIEWED 



Ar igona 

Project D 

Cali f ornia 

Project C 

Project G 

Project H 

Color ado 

Project J 

Louis iana 

Project A 
Massachusetts 

Project K 
Montana 
Project N 
New Mexico 
Project B 
Project L 
New Yor k 
Project E 
Project F 
Project M 
Texas 
Project I 
Project 0 
Project P 



Project 
language 



■Spanish 

Chinese/Spanish 

Spanish 

Spanish 

Spanish 

?L*ench 

Por tuguese 

Crow a/ 

Kerasan a/ 
Spanish 

S]:)anish 
Spanish 
Spanish 

Spanish 
Spanish 
Spanish 



a/American Indian languages, 



Year of 
operation 



Fifth 

Third 
Fifth 
Fifth 

Fourth 

Fourth 

Fourth 

Fourth 

Second 
Four th 

Third 
Fifth 
Second 

Fifth 
Third 
Fifth 



Grades 
covered 



Pre-K thru 5 

K thru 2 
K thru 6 
K thru 8 

K thru 4 

K thru 4 

K thru 4 

K thru 4 

K thru 4 
1 thru 4 

Pre-K thru 4 
Pre-K thru 12 
K thru 5 

K thru 6 
K thru 4 
K thru 4 



Enrollment 

838 

35:^ 
175 
1 ,488 

310 

660 

200 

175 

206 
300 

297 
930 
746 

2,185 
1,168 
700 



Federal 
f undin ci 



$ 75,653 

82,717 
149,400 
187,484 

146,000 

130,000 

91,669 

168,331 

88,320 
72,281 

127,000 
250,000 
180,000 

106,695 
196,000 
110,000 
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MEMORANDUM 



OKPARTMENl OF IIFAL I H, EDUCATION. ANT) WFLFARK 
OKFU.F. OF niK SKCRETARY 

DATE: DFIC. 2, 197 4 



TO: 



Assistant Secrotory for Education 



FROM: 



The Undo r Secretary 



SUBJECT: Departmental Position on Bilinqual education 



At the ASli: Management Conference on October 1, 1974 , I directed 
that OC promulqate a clear, detailed set of quidelines and clearly 
brinq to the attention of all concerned OC employees and qrantees 
the Federal policy for the Bilinqual education proqram. The basis 
for these quidelines was to be my testimony and that of the then 
Acting Director of Civil Riqhts before Conqress in March of this 
year / followinq the Supreme Court decision on the case of j^au^v^ 
Nichols , The purpose of this memorandum is to orovide OE addi- 
tTonai guidance to facilitate preparation of the quidelines. 

In its simplest terms, the Supreme Court in Lau affirmed the 
reSDonsibility of Local Education Aqencies (LEA's) to comply with 
Title VI of the^l964 Civil Riqhts Act, and HEW requlations and 
guidelines issued pursuant thereto. These quidelines and requla- 
tions require that school districts take affirmative action to 
rectify the language deficiencies of children of limited or non- 
English speaking ability in such a fashion tl^at they may enjov 
equal access to the educational oppor tunities'nbrovided to all 
other students by the school system. In its decision, the Court 
made clear that it is the responsibility of LEA's to develop 
appropriate affirmative action programs for students of limited 
or non-English speaking ability and that the goal of such oro- 
arams is "to ensure eoual educational opoortunity. The Federal 
responsibility is to ensure, under Title VI, that such proqrams 
are develooed' and imolemented — and, to that end, the Office of 
Civil Riqhts has markedly expanded its FY 1975 compliance program 
in this area. 

Beyond the Federal responsibility for Civil Riqhts compliance/ 
enforcement, the Administration and Conqress have assumed a 
Federal capacity building role in the area of bilinqual educa- 
tion. This role includes such related activities as research, 
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testing, and dissemination of educational approaches, models and 
techniques for teaching students with special education needs, 
curriculum development, teacher training, and technical assistance 
to States and LEA's. While these activities are Obviously not 
exclusively a Federal responsibility, and should not be, the ability 
of the Federal government to mount such efforts with the needs of 
the entire nation in mind makes it an obvious and substantial par- 
ticipant m such endeavors. It should be reiterated, hov/ever, that 
this Federal role is one of providing assistance to States and LEA's 
in building their capacities to address effectively the needs of 
limited and non-English speaking youngsters. It is not a service 
role which would supplant the historic State and locaT^responsi- 
bility for funding and administering this country's education system. 

The goal of this Federal capacity building effort, as is the case 
m Federal civil rights compliance/enforcement activities, is the 
provision of equal educational opportunities for all youngsters. 
As I have testified, the Federal government should clearly not 
insist, as some would seem to propose, that soecial lannuaqe oro- 
grams attempt to support the more extensive cultural interests of 
the various ethnic minorities in American society. The cultural 
pluralism of American society is one of its greatest assets, but 
such pluralism is a private matter of local choice, and not a 
proper responsibility of the Federal government. This interpre- 
tation of the goal of the Federal bilingual education program was 
confirmeo by the Conference Report on H.P. 69 (now p.L. 93-380) 
which states on page 148, "The House recedes to the Senate on the 
definition of a 'bilingual education program' with an amendment to 
emphasize the conferees' concern that the new definition not b^ 
misinterpreted to indicate, that an ultimate goal of the nronram 
IS the establishment of a 'bilingual society*." 

A frequent misunderstanding which seems to have provoked unnec- 
essary and fruitless debate over bilingual policy is the failure 
to distinguish the goals of bilingual/bicultural oroarams from 
the means of achieving them. p.l. 93-380 emphasizes 'strongly 
that "a primary means by which a child learns is through the use 
of such child's language and cultural her i taqe . . . and that children 
of limited English-soeakinq ability benefit through the fullest 
utilization of multiple language and cultural resources." But 
the law makes it equally clear that the ultimate qoal of Federal 
bilingual education programs is "to demonstrate effective ways of 
providing, for children of limited English-speaking abilitv, 
instruction designed to enable them, while using their native 
language j^_ to achieve c ompetence in the English^ianguage . " 
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As Stated in my testimony, we would obviously like to be able to 
specify the exact nature of appropriate programs to provide youngs 
sters of limited or non-English speaking ability eaual access to 
the educational opportunities provided all other students by the 
school system. However , given the current state of the art in 
bilingual education, this specificity is neither Possible nor 
desirable. Programs to provide competency in English for limited 
or non-English speaking children vary widely. They can range from 
special language tutoring, to separate English languaqe instruc- 
tion classes (and approaches very widely within this category), 
to bilingual education, to complete bilingual/bicultural educa- 
tion. Intuitively, programs — particularly for younqer children - 
with a strong bilingual/bicultural component would seem to be 
preferable from both an educational effectiveness and equal educa- 
tional opportunity standpoint to those which may impart some 
English speaking competence but deprive the limited or non-English 
speaking youngster of the opportunity to advance through the school 
system at a grade level commensurate with his or her age, while 
simultaneously failing to maintain in the youngster a positive 
concept of his or her cultural heritage. The particular approach 
and content of a model necessary to achieve this result, however, 
has not been identified. We simply do not have firm evidence to 
embrace any one model to the exclusion of others. 

The variations in concentration of limited or non-English speaking 
children in a district, the number of different languages involved, 
the ages of the youngsters, the degree of native language com- 
petency, and the degree of English * languaqe competency suggest 
that different approaches may be appropriate in different situa-^ 
tions. In particular, the approach necessary to enable youngsters 
of limited or non-English speaking ability presently in the school 
system to attain competency in English at a grade level commen- 
surate with their age may vary widely. 

The difficulties in specifying a single method for providing eaual 
educational opportunity to limited or non-English speaking young- 
sters were clearly recognized by the Congress in Title VII of 
P.L. 93-380. I refer specifically to Section 703, "Definitions; 
Regulations*' which reads in part: 

The term 'Program of bilingual education' means a program 
of instruction, designed for children of limited English 
speaking ability in elementary and secondary schools, in ^ 
which, with respect to the years of study to which such 
program is applicable 
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(1) there is instruction given in, and study of, Enqlish 
and to the extent neces sary (emphasis added) to allow 
a child to progress effectively through the educa- 
tjronal system, the native language of the children 
of limited English speaking ability, and such instruc- 
tion IS given with appreciation for the cultural 
heritage of such children, and, with respect to 
elementary school instruction, such instruction 
shall, to the extent nece ssary (emphasis added), 
be in all courses or subjects of study which will 
allow a child to progress effectively through th*^ 
educational system; " 

This same section further specifies that "in no event shall the 
program be designed for the purpose of teaching a foreign lanquaqe 
to English speaking children." It is clearly the intent of Congress 
that the goal of Federally-funded capacity building orograms in 
bilingual education be to assist children of limited^ or non-English 
speaking ability to gain competency in English so that thev may 
enjoy equal educational opportunity — and not to require cultural 
pluralism. 

In addition to the above definitions. Section 703 specifies that: 

.children enrolled in a program of bilingual education 
shall, if graded classes are used, be placed, to the extent 
practicable (emphasis added), in classes with childrerTof — 
approximately the same age and level of educational attain- 
ment. If children of significantly varyino ages or levels 
of educational attainment are placed in the same class, the 
program of bilingual education shall seek to insure that 
each child is provided with instruction which is aooropriate 
for his or her level of educational attainment." 

This requirement is reinforced by the stioulation that aoolica- 
tions for bilingual funds must be developed in consultation with 
a representative advisory committee, and that, where aopropriate, 
such committees include representatives of secondary school 
students to be served. 

Given the above, it should be possible for OC to develoo the 
guidelines for implementation of the Bil inqual Education program 
which I requested on October 1, 1974. Further, regulations and 
funding criteria for applications for bilingual demonstration 
projects should be consistent with those guidelines. To reiterate, 
both the guidelines and regulations should emohasize that the 
Federal capacity building role, as distinguished from the Federal 
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civil rights compliance/enforcement responsibilitieSr is to assist 
SEAS and LEAs in developing effective programs to provide equal 
educational opportunities to all their limited or non-English 
speaking students. No single program is appropriate for the 
individual circumstances of all LEAs subject to the requirements 
of Title VI of the 1964 Civil Rights Act as reinforced by Lau — 
and none should be specified. 

I look forward to reviewing the guidelines, regulations and funding 
criteria, and my staff will continue to closely monitor proqress in 
implementing Title VII of P.L. 93-380 through the OPS system, as 
well as other appropriate mechanisms. 




Prepared by: DOOLIN, EP, x51878, 11/22/74 
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PARENTS' OPINIONS ON T HE 

BIL INGUAL EDUCATION PROGRAM 

Parent s of children who are 

Limited 

English speakers English speakers 



1. Do you believe all 
subjects in your 
children's classes 
should be taught in 
English and Spanish 
(or other language)? 

/ Strongly in favor 
Moderately in favor 
No opinion 
Moderately opposed 
Strongly opposed 

2. Do you feel that your 
children's school 
should teach both the 
Anglo and Mexican (or 
other) cultures? 

Strongly in favor 
Moderately in favor 
No opinion 
Moderately opposed 
Strongly apposed 

3. How satisfied or dis- 
satisfied are you with 
the effect of the bili- 
gual classes on your 
children's ability to 
speak Spanish (or other 
language)? 

Very satisfied 

Satisfied 

No opinion 

Dissatisfied 

Very dissatisfied. 



101 
36 
5 
6 
6 



111 
37 
3 
2 
1 



88 
57 
8 
1 
0 



77 
51 
6 

22 
9 



98 
55 
0 
9 
4 



61 
82 

9 
13 

0 
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P arents o f children who ar e 

Limited 

Engl i sh speakers E nglish speakers 

" }■ ^ . • 

4. How satisfied or dis- 
satisfied are you 
with the effect of 
the bilingual classes 
on your children ' s 
ability to wr ite 
Spanish ( or other 
language )? 

Very satisfied 53 33 

Satisfied 60 68 

No opinion 11 35 

Dissatisfied 14 .19 

Very dissatisfied 6 1 

5. How satisfied or dis- 
satisfied are you 
with the effect of 
the bilingual classes 
on your children's 
ability to speak 
English? 

Very satisfied . 71 64 

Satisfied 64 76 

No opinion 12 16 v. 

Dissatisfied 6 8 ' 

Very dissatisfied 1 1 

6. How satisfied or dis- 
satisfied are you 
with the effect of 
the bilingual classes 
on your children's 
ability to write 
English? 

Very sat isfied * 59 42 

Satisfied 56 81 

No opinion 20 20 

Dissatis"fi|ed ^ 6 11 

Very dissatisfied 13 11 
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7. How satisfied or dis- 
satisfied are you 
with the effect of 
the bilingual classes 
on your children's 
ability to learn 
ar-ithmetic? 

Very satisfied 

Satisfied 

No opinion 

Dissatisfied 

Very dissatisfied . 

8. How long should your 
children remain in the 
bilingual classes? 

Until they can learn 
all subjects in 
both languages 

Throughout their 

school years (K-12) 

Other 

9. Would you like your 
children to be enrolled 
in the bilingual pro- 
gram next year? 

Yes 
No 

Do not care 



P arent s o f chil dren who a r e 

Limited 

English speakers English spea kers 



56 
74 
15 
8 
1 



37 

102 
15 



150 
3 
1 



45 
79 
26 
14 
0 



25 

97 
44 



152 
7 
6 
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DEPARTMENT OF HEALTH. EDUCATION. AND WELFARE 

OFFICE OF THE SECRETARY 



WASHINGTON. D.C. 20201 

Mar. 19, 1976 



Mr. Gregory J. Ahart 
Director, Manpower and 

Welfare Division 
U.S. General Accounting Office 
Washington, D.C. 20548 

Dear Mr. Ahart: 

The Secretary asked that I respond to your request for our 
comments on your draft report entitled, "Bilingual Education: 
An Unmet Need." The enclosed comments represent the tentative 
position of the Department and are subject to reevaluation when 
the final version of this report is received. 

We appreciate the opportunity to comment on this draft report 
before its publication. 

Sincerely yours, 

John D. Young 

y Assistant Secretary, Comptroller 

' \. . ■ 

Enclosure 
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Cojiments of the Department of Health , Education , and Welfare on the 
Ccmptroller General's Report to the Congress entitled, "Bilingual 
Education: An Unmet Need" — August 15, 1975 B160U31 (1) 



GAP. RECOMMENDATION 

The Secretary direct the Assistant Secretary fc/ education to: 

Fomtulate a plan to systematically develop effective bilingual 
educational approaches . 

DEPARTMENT COMMENTS 

We concur. The GAO report suggests an activity which would probably 
be ^ best undertaken along the lines of a "planned variations experiment." 
While we concur with this recommendation, our experience has led us to 
conclude that a grant-in-aid program (such as that authorized for 
Bilingual Education) is not an effective means for systematically 
developing and evaluating' effective bilingual education approaches. 
Generally, grant programs do not provide the front-end controls 
necessary to^yield the results GAO is seeking. In the absence of 
explicit legislative authority, those controls can only be provided 
through contractual arrangements which, until passage of the Education 
Amendments of 197U, were not available. 

The Education Amendments of 19 7^ amended the Bilingual Education Act 
with the inclusion of a new Part C, Section 742. The new section 
authorizes ,a variety of contractual activities to be undertaken both 
individually and cooperatively by the Canmissioner of Education ' and 
the Director, National Institute of Education. Given this new authority, 
a joint OE-NIE plan of action is being fomulated for the systematic 
development of effective bilingual education approaches as recommended 
by GAO. • 



GAO RECOMMENDATION 

The Secretary direct OE to: 

Require LEAs to establish (1) specific project goals consistent with 
the intent of Title VII and (2) clear, measurable perfonrance objectives 
to achieve the goals. To be consistent with program intent, project 
goals and objectives should address the levels of progress desired by 
. the participants in English proficiency and academic achievement in both 
English and the other language . 

DEPARTMEI^ COMMENTS 

We concur. The draft regulations contain provisions which require 
applicants to submit a description of the evaluation design for the 
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proposed project as a precondition for approval. The evaluation design 
must include provisions for assessing the applicant's progress in 
achieving the objectives set out in its application for assistance* 
It must also include provision for ccxnparing the performance of 
participating children on tests of reading skills in English and in 
the language other than English to be used in the proposed program. 



GAP RECQMMENDATIQM 

The Secretary direct OE to: 

Expand and improve the OE management information system so program 
managers have uniform, and consistent data needed to evaluate and 
manage the prcgram.. The e:g)anded system should be designed to pro- 
vide data to assess the effectiveness of the ^xpgram and each . 
Title VII pro:3ect> To accomplish the needed urprovements program 
regulations should be revised to specify minimum requirements for 
LEA evaluations, including CI) reporting format, (2) -Qxe academic 
subjects to be evaluated, (3) analysis to be made, and (H) an 
external standard, such as a control group, for comparison purposes , 

DEPARTTCNT CQHMENTS 

We concur. Draft regulations for the program require that applications 
for bilingual education projects include, at a minimum, provisions for 
assessing the applicants' progress in meeting its objectives, and 
specify that the evaluaticS design must include measurements of per- 
formance in reading skills in two languages; a description of, and the 
rationale for, the instrmnent to be used in evaluating the performance 
of participants in the pro-am; and comparison of such perfonnance 
with control data including appropriate tests of statistical signifi- 
cance. Reporting format will be suggested to the project directors. 
The Office of Bilingual Education will extract data from individual 
project reports for use in determining the effectiveness of the total 
program. ' ' 



GA.O RECOMMENDATION 

The Secretary direct .OE to: ^" ) 

Take steps to aggressively ijnplement the program requirements that KEAs 
subrnt evaluation reports on a timely basis. 

DEPARTMETir COM^EM'S 

We concur. The Office of Bilingual Education will notify _all project 
directors in writing at least (3) weeks before the established require- 
*'ment for the submission of the evaluation and expenditure reports and 
their deadline dates. This notification also includes suggested forrnat 
for the reports. . If this is not ^)roductive, the project directors are 
then contacted by telephone and again reminded of the requirements and 
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given new deadline dates. The project officer will provide guidance 
and technical assistance in. developing the evaluation reports and 
remind the LEAs of the need to submit them on time. Regulations for 
multi-year funding provide for continued funding on the basis of 
progress in meeting program objectives; and periodic evaluation 
reports are necessary as a condition to subsequent funding. 



GAP RECOMMENDATION 



The Secretary direct OE and NIE to: 

Examine the appropriate ness of testing instruments avai lable for 
children with limited English-speaking ability and, if needidT ^ 
take the necessary action to have better ones develo ped at the 
earliest possible date . 

DEPARIKENT COMMENTS 

We concur. Draft program regulations establish a network of OE support 
services for programs of bilingual education. This network is st)ecifi- 
cally directed toward the identification of appropriate instruments for 
measuring the educational performance of children of limited English- 
speaking ability, the assessment of the need for such instruments, and 
their appropriate usejin^rograms of bilingual education. In ortler to 
determine which measuring instruments are being used by project operators, 
the draft regulations require the applicant to provide a description of 
measurement instruments to be used in each project, the rationale for 
selecting such instruments, and procedures to be followed in their use. 

In close coordination with OE's support centers and program office, the 
National Institute of Education is supporting the development of assess- 
ment instruments for reading in Spanish, and in FY 1976 will support a 
critical analysis of existing instruments used in bilingual education 
across different languages, content areas, and grade levels. This 
analysis wfll include instruments developed locally as well as those 
distributed by publishers, and will assist in identifying areas wher^ 
new instrument development is needed. 



GAO RECOMMENDATION 

The Secretary direct OE to: 

Establis h classroom limits on the number of English-speaking participants , 
or use other methods which will provide added assurance that available 
program resources will reach the largest possible port ion of the target 
population . ^ — 

DEPARiriENT COMMCTTS 

We agree with what we understand to be the thrust of the recoirmendation; 
I.e., to ensure that limited program resources are used to benefit chil- 
dren of limited English-speaking ability. We recognize that the defini- 
tion of a "program of bilingual education" in section 703 of the amended 
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Bilingual Education Act contains restrictions on the extent to which 
English-speaking children may participate in assisted programs. These 
restrictions are reflected in the draft regulations for the program 
which will be published for public ccninent. We will review the question 
of limitations during this coitment period. 

In any event, through careful review of applications and increased 
monitoring of projects, we are confident that we can assure an appropriate 
balance among participating children. 

GAP RECOMMENDATION 

The Secretary direct OE and NIE to: 

Examine the apj^ropriateness of available testing instruments for 
assessing English language proficiency and, if needed, take the 
necessary action to have such instruments developed . 

DEPARTMENT COMMENTS 

We concur. OE has developed a network of .support centers for bilingual 
education that will be identi^ing, collecting, reviewing, developing 
and disseminating appropriate language proficiency assessment materials. 
Also the draft regulations require applijgarits to provide a description 
of instruments of measurement to be used in evaluating the perfonnance 
of participants in the program, the rationale for selecting such instrna- 
ments, and procedures to be followed in their use. 

Working closely with OE program officers, NIE in FY 1976 is investigatii« 
procedti>es used in identifying children in need of bilingual instructional 
programs that are based on assessment of language proficiency and pre- 
ference. Researx:h will be conducted to determine the consistency and 
accuracy with which alternative assessment procedures identify diildren 
in need of bilingual programs within language groups. Included in the 
research will be the procedures for identifying language preference 
designed by the Office of Civil Rights Act with respect to discrimination 
against limited English-speaking children (see the I^Oi vs. Nichols 
decision). I'he findings of this investigation will be used in part to 
determne the need for development of additional assessment procedures. 

NIE is also supporting an investigation to identify characteristics of 
limited English-speaking children which predict success in instruction 
provided in English. Included among the student characteristics on 
which data will be collected are proficiency in English and in the 
mother tongue, and attitudes toward language use. The results of this 
investigation could be used to detemdne the skill level necessary 
before cl^iildr^n can adapt to instruction in Ehglish or to develop more 
relevant and reliable assessment instruments. 
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P RINCIPAL HEW OFFICIALS 
RESPONSIBLE FOR ACTIVITIES DISCUSSED IN THIS REPORT 



SECRETARY OF HEW: 
David Mathews 
Caspar W. Weinberger 
Frank C. Carlucci (acting) 
Elliot L. Richardson 

ASSISTANT SECRETARY FOR EDUCATION! 
Virginia Y. Trotter 
Charles B. Saunders, Jr. 

( act ing ) 
Sidney P. Marland, Jr. 

COMMISSIONER OF EDUCATION: 
Terrel H. Bell 
John R. Ottina 
John R. Ottina (acting) 
Sidney P. Marland, Jr. 
Terrel H. Bell (acting) 
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Nov. 
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